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Foreword 


THERE WAS A TIME, NOT LONG AGO, WHEN PSYCHO- 
logical assessment consisted in the giving and scoring of an “‘intel- 
ligence”’ test, the Stanford-Binet most likely, or the Army Alpha. 
Then, in the twenties, came the adoption of Spearman’s distinc- 
tion between general and specific intelligence. The notion was that 
the first of these (G) could be measured by one of the already stand- 
ardized tests or an improved version of it, but that the measure- 
ment of specific intelligences called for a large armory of pro- 
cedures, one for each field of mental operations. This notion led to 
the construction of multifarious aptitude tests, the most dependable 
of which were those of mechanical comprehension and manual dex- 
terity. A little later, Thurstone proposed that general intelligence 
(G) was not a single factor, but a composite in varying proportions 
of several primary abilities. This analysis constituted the point of 
departure for subsequent elaborations and refinements culminating 
in the currently favored scholastic aptitude tests and in the Wechs- 
ler-Bellevue, with its ten sub-tests and one alternate vocabulary 
test, today’s peak of practicality and validity in the field of intelli- 
gence-testing. ‘These and parallel evolutions were all in line with 
the initial assumption that the way to predict future achievement 
in a designated field of activity or, more particularly, in a designated 
role, is to measure each of the essential specific intelligences, or 
skills, as well as the candidate’s general intelligence, “intellectual 
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aptitude,” or “ability to learn.” Prerequisite to this method is a job 
analysis that defines precisely which varieties of skills are involved 
in the functions, or tasks, to be performed. 

The beginning of the second stage of assessment’s history came 
shortly on the heels of the first. It was characterized by the addi- 
tional endeavor to estimate “will to achieve,” the rationale being 
that ambition and capability are two analytically separable deter- 
minants of performance, which do not invariably run together. 
There are over-achievers who do much better than their intelli- 
gence and aptitude scores would lead one to expect, and there are 
under-achievers who do worse. For the best results, ability must be 
coupled with a general disposition to “do well” or to “get ahead,” 
or better with a focal urge for accomplishment in the elected field. 
How is this dispositional factor to be assessed? 

The instruments devised by Downey, Spearman, and others to 
measure “will” (W) yielded no decisive findings, and psychologists 
turned to more sensible, though less objective, methods. It is now 
generally assumed that it is not possible to “measure,” in any exact 
sense, the enduring inclination of a person to engage wholeheart- 
edly in a prospective enterprise, the dependable strength, in other 
words, of his need for a specific kind of achievement. This variable 
comprises, in different proportions, such things as the enjoyment of 
the activity for its own sake, interest in the content or subject mat- 
ter, desire to perfect the required skills, ambition to complete each 
undertaking as well as possible, with self-respect dependent on these 
completions, zest for competition, and the hope for recognition and 
prestige. The strength of this compound of interdependent tend- 
encies can be only roughly “estimated” after a judicious appraisal 
of the candidate’s record of relevant past achievements, especially 
of some recent rise or decline of performance level, and an intuitive 


evaluation of his avowals of interest and of intention respecting the 
designated role. For this estimation, interviewing is the preferred 
procedure, despite the realization that one determinant of the 
amount, the relevance, the truthfulness, and the proper rating of the 


subject's self-report is the personality and talent of the interviewer 
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himself. Notable in this connection is an elaborate, indirect, objec- 
tive method devised recently by McClelland and his co-workers for 
measuring the strength of an experimentally evoked, and hence 
momentary, achievement need. 

The third phase of development in the field of assessment was 
initiated by the confluence of two currents of thought and practice. 
One had its source within the domain of psychology itself where 
studies of individual differences had resulted in the demarcation of 
a new area of specialized concern called the “psychology of per- 
sonality” and in the construction of numerous questionnaires as in- 
struments of exploration. The second current was a rough invasion 
of the prim precincts of psychology by the shocking facts and dra- 
matic formulations presented by Sigmund Freud. Immediately it 
became patent that many people fail in accomplishment, not be- 
cause of any inherent deficiency of ambition or of ability, but be- 
cause of the impedient effects of a submerged neurotic conflict, of a 
psychosomatic irregularity, or of an incipient psychotic state. Rec- 
ognition of this possibility gave birth toa new and more challenging 
objective, that of exposing whatever covert dispositions and con- 
flicts may be currently affecting, or might some day affect, to a dele- 
terious degree, the emotional balance and/or mental efficiency of 
asubject. 

In detecting the presence and estimating the severity of a neu- 
rosis or psychosis, tests of mental functioning proved useful as did 
certain of the more sophisticated questionnaires, among which to- 
day the Minnesota Multiphasic appears to be most valuable. Even 
more pertinent were autobiographical data obtained in interviews 
or from written documents. Then the Rorschach and other projec- 
tive tests made their timely debut and found a host of eager stags 
to dance with them. Acquiring some proficiency in handling these 
instruments and the imagination they elicited, clinical psycholo- 
gists adopted as their crowning goal a sufficient formulation of the 
dynamics of each personality. One mode of formulation is in terms 
of a system of overt enterprises prompted and sustained by the col- 
laboration of numerous accepted needs and protected by one or an- 
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other defensive mechanism against an aggregate of unaccepted com- 
plexes. 

At first, errors of diagnosis and prediction occurred with discon- 
certing frequency. The assessors, it can now be seen, were too often 
misled by the abundant signs (elicited by the new tests) of the in- 
fantile experiences which psychoanalysts had identified as the prime 
determinants of neurosis. It was not then realized that many chil- 
dren suffer severe deprivations, illnesses, injuries, and insults, live 
through a season of psychic sores and shames, and come out on the 
other side with ego structures that are capable of standing up more 
staunchly to later strains and challenges than are many egos to 
which such traumata are foreign. Granting the gift of constitutional 
resiliency, recent observations indicate that the furnaces of affliction 
may serve to temper, more than to weaken, the evolving establish- 
ments of a personality. But we must confess that even now, after two 
decades of clinical research, we lack sufficient criteria for judging in 
each case how seriously imaginal signs of a repressed complex should 
be taken. 

What I am calling the fourth phase of assessment history was an 
early and inevitable outgrowth of the third. Its logic was based on 
two self-evident propositions: one, that neurosis and social mal- 
adjustment have a reciprocal cause-and-effect relationship; and two, 
that most employments, most roles, are carried out within a hier- 


archical social structure, the component members of which interact 


both horizontally and vertically, and that the work-enjoyment and 


work-efficiency of the interactors is affected to a varying extent by 
the degree of compatibility or incompatibility, of attraction or re- 
vulsion, of good-will or bad-will, which prevails among them. Per- 
ceiving this, psychologists came to the conclusion that each candi- 
date should be rated in respect to the disposition and the ability to 
“get along with others”—with peers, superordinates, and subordi- 
nates. Often included in this class of variables is leadership po- 


tentiality, a compound of several needs, talents, and establishments, 
such as knowledge of the field of endeavor 


í and the ability to utilize 
this knowledge in goal-selection, plan 


“construction, and day by day 


12 


Foreword 


(crisis by crisis) decision-making (strategic, or tactical, ability), com- 
bined with persuasive and affiliative ability (the power to win the 
trust, respect, co-operation, and affection of other people). Among 
the techniques employed today to arrive at estimates of this sort are 
sociometry and life-like situations calling for make-believe en- 
deavors (role-playing). 

In composing this summary of evolutions in the sphere of assess- 
ments I have found it useful to discriminate, 1., a dispositional fac- 
tor (including interest in, enjoyment of, and inclination to engage 
effectively in, a given kind of activity— a need, say, for a certain type 
of achievement), and 2., a capacity factor (general mental ability, or 
intelligence, plus whatever special aptitudes are required). In con- 
formity with current terminology the testing of the second factor— 
so-called intelligence and most aptitudes—was placed in the first 
phase of scientific development. Considering this decision in con- 
nection with later developments it becomes apparent that what 
psychologists have generally had in mind when they spoke of “‘intel- 
ligence” is the ability to comprehend and to manipulate verbal 
concepts and numerical symbols, and, to a lesser extent, the ability 
to comprehend and to manipulate material utilities. The ability to 
comprehend and manipulate people (leadership potentiality), men- 
tioned in connection with the fourth stage of assessment, has seldom 
been explicitly subsumed under the term “intelligence.” Why is 
this? One reason may be that the word “intelligence” has come to 
stand for something that can be measured by means of a paper-and- 
pencil test, and neither strategic nor persuasive ability is susceptible 
to this mode of appraisal. (Perhaps the closest approximation to 
such an instrument is Moss's test of social intelligence.) Another 
reason may be that the kind of intelligence which is rated by the 
tests that psychologists design is the kind which psychologists them- 
selves exhibit to a relatively high degree, and hence they are all-too- 
humanly disposed to think that this is the real thing. Finally, and 
more decisively, “making friends and influencing people” depends 
on a number of other factors—an inviting appearance, for one— 
which do not belong to the category of abilities. 
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Theoretically, the chief difference between a social need and all 
other sorts of needs is that the latter, when capable, achieve their 
goals directly, either by manual or by purely mental operations; 
whereas the aim of a social need is an emotion and/or a course of 
action emanating from another person. That is, it is something 
which cannot be achieved by direct manipulation. There may be 
some physical pushing or pulling now and then, or even murder; 
but, as a rule, the subject must do and/or say something to gain the 
attention of the alter, to engender the desired feeling or need in 
him, and to induce it to express itself in a manner consonant with 
the subject’s goal. In other words, the subject cannot take hold of 
the alter’s muscular or verbal apparatus (even by ‘“‘brain-washing,” 
or better, “brain-bombing’’), but must excite it indirectly via the 
alter’s systems of dispositions. 

Worded in this way, the statement may bring to mind the “need 
for dominance,” or the “will to power,” which, when present in 
pure form, unleavened by other needs, is, in everyday life, more 
likely to fail than to succeed. In isolation, Machiavelli could dress 
himself in the vestments of a courtier and write a manual for the 
will to power, and during some eras in some countries this com- 
pendium of crafty tricks can certainly be of service to a cunning 
ruler; but in other periods of history, in other climes, or almost any- 
where in the long run, as soon as people apperceive the will to 
power naked in a leader who evidences no affection or respect for 
them, whose decisions are not regardful of the common good, or 
who is not dedicated to the attainment of an acceptable social pur- 
pose, resistance to his rule will mount and his days of effectual 
governance will be numbered. In most societies or groups the lead- 
er’s need for dominance (decision-making) must be restricted to the 
service of a shareable aim and be combined with an abundance of 
good-will and charity toward other members. The ideal stands 
somewhere between the Scylla of Authoritarianism and the Cha- 
rybdis of Casper Milquetoast. In short, leadership potentiality de- 


pends on a very complicated balance of endowments, dispositions, 
and abilities which can be estimated only roughly. 
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Here, if anywhere, is the place for the unpopular observation that 
totalitarianism has made the evils of unchecked ruthless dominance, 
on the one hand, and of unquestioning acquiescence and obedience, 
on the other, so obtrusive and obnoxious in our eyes, that today no 
form of ordinance is regarded with much favor. Relative to this is- 
sue, our defense mechanisms will seldom permit us to acknowledge 
that frequent, indignant objections to the statements or decisions 
of a superordinate are, in most cases, no more than an equalitarian 
masquerade, or cover, for neurotic narcism or for narcism plus a 
frustrated and repressed dictator complex. We seldom acknowledge 
that “headaches” of this stamp are as detrimental as an authoritarian 
leader to the morale of a group, and consequently, none of us, so far 
as I know, has seen fit to estimate what might be called subordinate 
capacity (the capacity to comply with the decisions and to execute 
the plans of a duly appointed leader without covert resistance or 
overt fuss and fury). 

Now, let us assume that we have a candidate for a certain job who 
has received a high rating on all the so-far-mentioned variables. His 
assessors are satisfied that he possesses a dependable need to perform y 
this job with distinction, coupled with high general intelligence and 
all the essential specific skills. He has shown he is well disposed 
towards other people and is capable of harmonious co-operations. 
He has as much executive ability as the role requires. His health is 
excellent, and his protocols show no signs of embarrassing neurotic 
conflicts. What is left to be appraised? 

In World War II, during assessment’s fifth phase of development, 
came the realization that the environmental conditions under 
which a given role must be fulfilled may be so intolerable to a per- 
son that his morale collapses and ceases to provide a base for his am- 
bition and his powers. He becomes despondent or irritable, loses 
patience with his colleagues, quarrels ensue, and the efficiency of 
his unit deteriorates. The intolerable conditions are either of physi- 
cal origin—unpalatable food, extreme heat or cold, incessant rain, 
constant noise, lack of space, stinging insects, etc., —or, more often, 
they are social in nature—incompatible associates, a domineering 
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or inept superior, arbitrary and oppressive rulings, injustice, in- 
sufficient pay, insufficient appreciation, no promotions, etc. It is not 
easy to predict reliably a person's capacity to take such tribulations 
in his stride, but autobiographical data supplemented by checks on 
an inventory of discomforts and annoyances will usually supply 
sufficient cues to guide a gently probing interviewer to the foci of 
lowest tolerance. 

Besides tolerance of discomforting conditions (and by this I mean 
conditions on the job, or vocational conditions), two other factors 
should be included among the topics of concern that were added 
during the fifth phase of assessment history: extra-vocational activi- 
ties and extra-vocational conditions. Common sense testifies to the 
possible good or bad effects of each of these upon a man’s efficiency. 
At one extreme of the first continuum are those who do things dur- 
ing their unscheduled hours which are an advantage, in one way or 
another, to the enterprise to which they are committed; and, at the 
other extreme, are others whose off-duty interests or addictions dis- 
astrously interfere with the pursuit of their vocation. Under-achiev- 
ing at college, for example, is very often the result of having one or 
several all-absorbing, and hence diverting, extra-curricular con- 
cerns, such as athletics, sex, or drinking parties. In the United 
States the commonest offender in later life, statistics say, is chronic 
alcoholism. As for extra-vocational conditions, there are a miscel- 
lany of things—conflictful family or 
or unfaithful spouse, 
litigations, etc.—w 


marital relations, a semi-insane 
a delinquent or feeble-minded child, financial 
hich may seriously impair the emotional balance 
ofa person and thus lower his level of role performances. There are 
also beneficial influences of this class. Here the reader may be re- 
minded of the new tenet—fitting item for John Marquand’s collec- 
tion of Americana—that one should interview the wives of candi- 
dates for managerial positions in business before making a decision, 
on the ground that the “little woman” can do a lot to aid or to im- 
pede her husband’s strenuous climb up the ladder of success. 

Before concluding, it should be noted that from the 


; start psy- 
chologists have attempted wherever possible to use techni 


ques or to 
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devise new ones which could be administered to many subjects at 
once. Group tests are great time-savers, and when the flow of candi- 
dates is very large this virtue is necessarily decisive. As things stand 
today, however, the most deeply revealing procedures (though not 
usually the most reliable predictors of future achievement) are 
scarcely or not at all suitable for group administration. 

The basic mode of analysis that was adopted for this survey was 
that of dividing the hypothetical role (slot) to be occupied by the 
selected applicant into its principal component functions, or tasks, 
including, of course, whatever social functions are comprised. It was 
assumed, furthermore, that for the successful execution of each of 
those principal functions, a person should have both the relevant 
disposition (need to perform it) and the relevant aptitude (present 
ability or ability to develop the ability). It is best if the applicant’s 
need to perform a given function is a need in its own right, i.e., that 
he enjoys the activity per se as well as its immediate effects; but the 
intention to perform the task as well as possible may be a particular 
manifestation of a generalized need for achievement or a sub-need 
which operates instrumentally in the service of a more comprehen- 
sive or more distal aim. In any case, the role-occupant must not only 
want (for one reason or another) to do the required thing, but pos- 
sess enough ability to do it as quickly and as perfectly as is expected. 

The only other mode of analysis that I used was that of categoriz- 
ing the impediments to good performance, first into internal and 
then external ones. The internal impediments consist of whatever 
repressed tendencies and complexes are likely to produce disquiet- 
ing psychosomatic or neurotic symptoms and whatever dispositions, 
if occasionally or habitually vented, on the job or off the job, which 
will diminish or defeat the effectiveness of role-performance. In the 
class of external impediments belong all occupational and extra- 
occupational conditions which are difficult to tolerate with equa- 
nimity. Here the task of an assessor is to ascertain what impediments 
exist or are likely to occur and then to estimate the subject’s de- 
pendable powers of resistance and defense. It is at this point that the 
question of ego strength, or structure, will most insistently arise. 
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These two modes of analysis—into relevant needs and abilities, on 
the positive side, and into internal and external impediments, on 
the negative side—are justified, it seems to me, on theoretical 
grounds; but it must be admitted that the variables they yield are, 
in many instances, difficult to define in a quantitative, operational 
manner and difficult to assess predictively. Several gross variables, 
such as social intelligence, strategic (decision-making) ability, and 
persuasive ability have yet to be analyzed into their component 
skills; and there is still much confusion respecting the determinants 
of so important a variable as social compatibility. Consequently, 
theory and practice are still pretty far apart. I could have stayed 
close to practice if I had adopted an alternative mode of slicing the 
chronology of assessment—not at the introduction of each new aim 
(new set of variables to be measured), but at the adoption of each 
new procedure or class of procedures. This, however, would have 
increased the distance between the assessment enterprise and the 
demands of the subject’s future situation, since we are still very 
hazy respecting the nature of the variables that are measured by 
each test and the importance of these as determinants of role-fulfill- 
ments in social situations. 

So much for the past history of assessment. The book that is be- 
fore you opens a new chapter, marking the sixth stage of develop- 
ment. The authors took account of all the factors I have mentioned, 
but on sufficient grounds, set aside those that were least relevant to 
the tasks they undertook. They started with a comprehensive “‘ana- 
lytical” approach not unlike the one described in Assessment of 
Men by the assessors of the Office of Strategic Services, but in later 
researches took up a somewhat novel position which proved un- 
usually successful. 


As the authors state, their chief problem was “improving predic- 
tions from test data,” which, to be sure, is nothing new: a high cor- 


relation between ratings at assessment and later indices of achieve- 
ment has been the explicit or implicit aim of all previous endeavors 


in the field of selection. But in this case we find a much firmer grasp 


of the realities of the validating process, and hence, for the first 
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time, an adequate definition of the determinants of the later ratings 
of achievement, the target, one might say, of the entire enterprise. 

A little caricature might serve to sharpen our awareness of the 
step that has been taken by Professors Stern, Stein, and Bloom. Let 
us assume that the assignment is to predict grades in an English 
course given by Professor X. Responding to this challenge, psy- 
chologists of the old school would devote almost all their time to 
the construction of tests, let us say, of verbal facility, literary ap- 
preciation, and so forth, and combine these with a test of general 
intelligence to provide a measure of “aptitude for English studies.” 
The authors of this volume, on the other hand, would start by ob- 
taining as much information as possible about Professor X’s tastes, 
especially the explicit and implicit standards that determine his 
grading of term papers and of final examinations. They would ask 
the Professor what special merits he saw in his best students and 
what particular objections he had to those he esteemed least. ‘They 
would also conduct a systematic examination of the students who 
had received the highest grades in Professor X’s course and those 
who had received the lowest. Then, on the basis of these and other 
data of the same order, the psychologists of this new school would 
compose a model of the type of personality that is most likely to re- 
ceive high grades in Professor X’s course. This model would consti- 
tute a target. Then, having clearly defined it, and not before, these 
psychologists would apply themselves to the task of selecting and 
devising instruments to measure the extent to which each appli- 
cant’s personality approximates the model. In short, they would 
formulate—much more specifically than have previous assessors— 
the demands of the prospective situation, the kinds of persons who 
have met those demands successfully, and the system of values of 
the judge or judges who will make the ratings with which the as- 
sessment scores will eventually be compared. To take one more ex- 
ample, these psychologists would not be satisfied to discover whether 
or not an applicant is generally compatible with other people; they 
would want to determine, as far as possible, how compatible he is 
likely to be with the specific group with whom he will associate if 
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selected. This method represents an extension of the concept of job 
analysis so as to embrace concretely the social and interpersonal 
aspects of the job, and furthermore, to embrace the standards of 
those who will give the final ratings of job performances. 

Since it would be wrong of me to give away the plot that is un- 
folded in the coming chapters, I must conclude my part with this 


fanciful synopsis and bowing out, recommend that you proceed and 
come to grips with the real substance of assessment. 


Henry A. Murray 
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CHAPTER 1 


Introduction 


THE TWENTIETH CENTURY HAS SEEN THE EMERGENCE 
of psychology as a field of prediction and control as well as one of 
analysis and description. Psychologists have been called upon with 
increasing frequency in recent years to predict behavior in an ex- 
ceedingly wide variety of situations. The armed forces turned to the 
psychologists to screen persons who could not adjust or were not 
readily adaptable to military life, to select officers, and even to as- 
sess both civilian and military personnel for their capacity to or- 
ganize and participate in underground movements during the sec- 
ond World War. Industrial administrators and personnel have 
sought means of determining the aptitudes and effectiveness of in- 
dividuals for various types of jobs, executive and supervisory as 
well as production. Educators also turned to psychology for means 
of determining which students would or would not succeed in 
specific schools, analyses of skills and abilities for guidance pur- 
poses, the early discovery of talent, the significance of under- and 
over-achievement, etc. 

Common to all these problems was the desire to increase the 
probability that individuals being selected for participation in these 
various kinds of institutional programs would do so with maximum 
efficiency and economy both for themselves and the institution in 
question. Representatives of education, industry, and government 
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had all begun to recognize the tremendous cost involved when all 
comers were accepted indiscriminately or screened inefficiently, 
making it almost a matter of chance as to whether a person would be 
assigned to positions where his contribution could be maximized. 

Thus, long before the psychologist had set his own house in or- 
der, there was a pressing social need for the application of his 
knowledge. Unequal rates of development in such fields as tests and 
measurements, personality, statistics, learning theory and, above 
all, the lack of integrating theories of behavior, were not permitted 
to deter the psychologist from recognizing social demands. And, in 
fact, the impetus of these applied problems was soon discovered to 
be a source of further contribution to psychological theory and 
knowledge. 

In the process of developing solutions to these urgent practical 
problems remarkable ingenuity was demonstrated in the construc- 
tion of a wide variety of testing instruments and techniques for 
analyzing results. Considerable success attended the application, 
for example, of intelligence, achievement, and aptitude tests in edu- 
cation. Poor scholastic risks could be distinguished with increasing 
accuracy from those more likely to succeed. Even if the improve- 
ment in prediction over what had previously been the case was rela- 
tive, rather than absolute, it was now apparent that the individual 
himself constituted a source of evidence from which it was possible 
to predict future behavior. This demonstration marked a signifi- 


cant advance for the field of psychology. Unlike the other social 


sciences, the peculiar concern of the psychologist is with the indi- 


vidual. It now seemed that the individual w. 
to provide the basis for a predictive science, 

However, the presumed specificity of these 
gence, achievement and aptitude, and their 
inter-individual and 


as sufficient in himself 


measures of intelli- 


independence from 


i social factors, was more illusory than real. The 
achievement tester was well aware of the situation 


which the behaviors to be measured we 
such processes as counting 


al context in 
re imbedded. Exposure to 


a pa » numbers, addition and subtraction, 
multiplication and division, occurs in a definite and closely regu- 
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lated sequence in the elementary school. By collating a series of 
questions and problems involving such processes and administering 
them to students at various grade levels, little difficulty was en- 
countered in constructing a nomothetic instrument which would 
discriminate between those capable of performing the tasks ap- 
propriate to a given grade level and those who were not. The suc- 
cess of the discrimination was actually as dependent upon the isola- 
tion of environmental factors as it was upon individual differences, 
albeit an environment so restricted as to consist of little more than 
the sequential appearance of a series of arithmetic tasks. 

The initial successes in the field of tests and measurements were 
soon checked by two serious problems. In the first place, some stu- 
dents for whom the test results indicated a high probability of 
achievement nevertheless failed, and attempts to reduce the error 
associated with such predictions proved inadequate. Secondly, once 
preliminary testing had reduced the original population to a small- 
er group of selected participants, it became difficult to discriminate 
within the narrowed range of talent thus left. Success and failure 
continued to attend the scholastic efforts of this more homogeneous 
sample of students, but the tester’s capacity for differentiating at 
this level on the basis of some extension of his original measures 
seemed to be exhausted. 

The answer to both these problems apparently lay in areas other 
than those already explored by intelligence, achivement, and apti- 
tude testing—areas which had just begun to receive increasing at- 
tention in psychology: motivation, emotional adjustment, and 
interpersonal relations. It became evident that, once the question 
of minimal intellectual competence had been resolved, critical im- 
portance would then be attached to such matters as the manner in 
which a student could get along with his classmates, the extent to 
which he was accepted or rejected and the significance which he at- 
tached to such responses from others, the character of his relation- 

ships with the teacher, and the extent to which he might be free 
from sources of anxiety and concern which might interfere with his 
capacity to absorb and integrate the academic experiences being 
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offered him. The attentions being paid to such non-intellectual fac- 
tors in performance were making increasingly evident the complexi- 
ties of the situations for which predictions were desired. 

The same considerations applying to educational measurements 
were no less evident in the area of vocational testing and industrial 
selection. Where adequate job analysis permitted the construction 
of tests which included samples of behavior related to job perform- 
ance, a measure of success in prediction was attained. But with the 
selection of foremen, sales personnel, or executives, whose work 
did not involve discrete units of neuromuscular co-ordinations, at- 
tention once again was directed towards questions of personality 
and interpersonal relationships. 

With this shift in emphasis from cognitive and motor skills to 
personality dynamics and interpersonal behaviors, another facet of 
psychology came to the fore. The psychoanalytic and personological 
schools and their numerous off-shoots not only provided a rudi- 
mentary theoretical structure, but contributed to the development 
of projective tests and other forms of personality indices as well. 
One of the effects of the phenomenal multiplicity of personality 
measures which appeared, together with an attendant specializa- 
tion among the interpreters of such devices, was a trend towards the 
utilization of impressions from several investigators employing dif- 
ferent tests on the same subject. This trend was further accelerated 
as a consequence of the observation that interpretations of per- 
sonality dynamics could be affected by certain biases or blind spots 
attributable to the personality of the observer. The potentialities 
inherent in an approach based upon the pooled efforts of a variety 
of personalistic specialists were indicated quite clearly in the diag- 
nostic conference technique employed by H. A. Murray and his 
associates at the Harvard Psychological Clinic. 

By the late 1930's the psychologist had become equipped with a 
substantial battery of tools, ranging from tests of motor co-ordina- 
tion to tests of abstract processes, and including an orientation to 
the study of personality as well as a variety of relevant procedures 
and methods. Although opportunities for the application of a broad 
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approach to the assessment and prediction of behavior were not 
lacking, the first large-scale program to embody fully all of these 
developments did not appear until the second World War. 

At this time the United States was confronted with the need to 
select individuals for highly critical underground activities abroad. 
On the basis of work already accomplished by Simoneit in Germany 
and Harris and his associates in Great Britain, a group of American 
social scientists including psychiatrists, sociologists, and anthro- 
pologists as well as psychologists, was brought together in order 
to establish an assessment program for the Office of Strategic Serv- 
ices (OSS). The OSS staff was charged with the responsibility 
“. . . of developing a system of procedures which would reveal the 
personalities of OSS recruits to the extent of providing grounds for 
sufficiently reliable predictions of their usefulness to the organiza- 
tion during the remaining years of the war” (45, p. 8). The pro- 
cedures which were subsequently devised included interviews, in- 
telligence tests, paper and pencil tests of personality, projective 
tests of personality, situational tests, and a modified case conference 
approach for the integration of these diverse data. The assessees 
were extremely heterogeneous, not only in terms of cultural back- 
grounds (Spaniards, Hungarians, Chinese, Koreans, to mention 
only a few), but also in terms of their personal histories and previ- 
ous experiences. The diversity of this population was matched in 
turn by the variegated collection of jobs for which these men were 
being assessed. Some were being screened as potential finance 
officers, others for supply, and still others as parachutists, leaders of 
guerilla units, saboteurs, propagandists, etc. 

Obviously no adequate job analysis for these various enterprises 
could be made available; the assessors found themselves making pre- 
dictions about behavior which could be expected to occur in situa- 
tions about which practically nothing was known. Under these cir- 
cumstances they were forced to fall back upon overall estimates of 
capacities to function adequately regardless of the exigencies of any 
particular situation. When the war was nearing its conclusion and 
attempts to evaluate the effectiveness of the assessment program 
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were undertaken, two related difficulties became apparent. The 
first involved a recognition of the lack of consistency between the 
frames of reference of the original assessors and those individuals in 
the field situation who were asked to appraise the subsequent per- 
formance of the OSS assessees, rendering any comparison between 
ratings from these two sources meaningless as a source of validation 
for the assessment. Furthermore, the job assignments themsclves 
were frequently changed between the time the man had been as- 
sessed and his eventual arrival in the ficld, making even the piece- 
meal estimates of the assessors regarding the ultimate field situation 
for a particular individual almost wholly irrelevant. As a result a 
definitive evaluation of the OSS program was impossible. The mem- 
bers of the OSS assessment staff were, however, “virtually unani- 
mous in their opinion that the OSS system of examination and 
diagnosis was better than any with which they had previously been 
familiar’ (45, p. 462). 

Thus, the major stumbling block in the OSS program lay ina lack 
of knowledge regarding the situation in which the subject's per- 
formance was to take place, and a resulting lack of specificity in the 
criteria on which these men could be assessed. The OSS staff was 
fully aware of these difficulties, but was unable to surmount them 
as a result of the inherent limitations of the wartime operation. 
However, in the guiding principles for assessment procedures which 
emerged from this experience, the staff was careful to indicate the 
importance of the criterion problem and to suggest possible means 
of dealing with it. 

After the war much enthusiasm was generated for the OSS as- 
sessment procedures. This was especially marked among those who 
had participated in the design and execution of the OSS program. 
But there were others who were inclined to view 


this development 
with scepticism, particularly among psychologists who had al- 


ready come to regard projective tests, depth interviev 


ving, and clini- 
cal procedures in general with disfavor. 


The lack of unequivocal 
statistical evidence concerning the effectiveness of the OSS opera- 


tion contributed still further to this division of opinion. 
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Although the results of the OSS experience were not published 
until 1948, knowledge of its procedures, orientation towards assess- 
ment, and results, had already become widespread. Consequently, 
in 1946 when the Veterans Administration became concerned with 
the selection of trainees for its Clinical Psychology Program, the 
full-scale assessment project which followed under the direction of 
Kelly and Fiske was sensitive to the issues raised by the wartime ex- 
perience. 

This was the first post-war, large-scale assessment program, in- 
volving 280 assessees and almost half as many assessors. The project 
was carried out on a rigorous experimental basis, and was devoted 
to two major purposes: 


a. The experimental study of the validity of all potentially predictive 
devices including not only conventionally used objective tests but 
also clinical judgments based on a wide variety of materials such as 
projective test protocols, autobiographical materials, interviews, 
psychodrama, and other situation tests. 

b. The development of criterion techniques and the accrual of mean- 
ingful measures, not only of success in completing training but also 
of the actual performance of professional duties. (32, p. 1) 


The results of this program indicated that only two tests, the Mill- 
er Analogies and the Strong Vocational Interest Blank (Psycholo- 
gist Key) had any predictive value. The first correlated --.47 with 
rated Academic Performance, the second +.43 with rated Research 
Competence. None of the other objective personality tests and pro- 
jective materials yielded correlations as high as these. 

As McNemar concluded, in his review of the VA assessment 
project, 


- if psychologists with ample funds and the best available person- 
nel at their disposal cannot come up with a better solution to the predic- 
tion problem than achieved by this project, the question may be asked 
as to whether we haven’t oversold certain psychological services (39, 
p- 860). 

Some day, if an informal history of psychology is written, it will 
have to contain a chapter on the internecine warfare among psy- 
chologists of this period. Despite the fact that McNemar and a num- 


29 


Methods in Personality Assessment 
ber of others had pointed out the inadequacies and limitations of 
the VA assessment program, many psychologists drew the conclu- 
sion that this study provided definitive evidence of the inadequacy 
of clinicians to predict behavior—even that of their own colleagues. 
This criticism of clinicians and clinical instruments was not even 
tempered by the fact that many others besides clinical psychologists 
had been involved in the VA study. The romance with clinical 
psychology was over, and considerably more effort was expended in 
the celebration of this fact than in the serious examination of the 
crisis which confronted assessment methodology. 

What was the Achilles heel of the VA assessment program? If we 
accept the argument that all of the paper and pencil tests, projective 
tests, interviews, etc., were actually appropriate to the specific assess- 
ment problems involved, and if we accept the contention that the 
simplified ratings which had to be made from some of these complex 
tests in order to obtain scores suitable for correlational purposes 
were indeed adequate—although both these points are debatable— 
the Achilles heel of the VA study continues to reside in the criterion 


problem which had been raised by the OSS project previously, The 
reporters of the VA project themselves comment that: 


Many of our correlations and other findings therefore represent a 
sort of averaging effect, possibly obscuring certain higher degrees of 
relationship in some training centers because of the absence of these 
relationships in other training centers (32, p. 80). 

In the spring of 1947 we asked the supervisors in VA installations to 
rate the VA trainees under their supervision on eight cr 
In the instructions for these ratings the reference po 
dicated to be clinical psychologists employ 
or above, excluding trainees, Subsequent 
instructions were unsatisfactory because y 
not in a position to use such a national fr 


they used as their frame of reference those VA employees with whom 


they were acquainted, a reference group which varied greatly from 
installation to installation (32, p- 80). f 


To simplify the task of the raters, [in M 
on only three variables: Academic Perfor 
and Clinical Competence. This time we a 
population VA trainees at all levels in t 


iterion variables. 
pulation was in- 
ed in the VA at the P-3 level 
analyses indicated that these 
nost of the supervisors were 
ame of reference. Presumably 


ay, 1948] we asked for ratings 
mance, Research Competence, 
sked raters to use as a reference 
he training program. As might 
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be expected the resulting distributions of ratings were all badly skewed; 
in fact, there was but little differentiation beween trainees. 

Even more significant was the finding that the average rating varied 
considerably from one university to the next. Thus the trainees at one 
university would all be rated 6, 7, or 8, while at another university the 
trainees would be rated 4, 5, and 6. These inter-university differences 
were significant at the 1% level (32, p. 81). 

And finally these reporters note that the intercorrelations be- 
tween the final composite criterion ratings varied from +-.26 to 
+-.84, with a median of ++.60, indicating “. . . either a consider- 
able lack of specificity of clinical skills or an inability on the part of 
our judges to evaluate these skills independently” (32, p. 84). 

These quotations reflect some of the difficulties that the VA as- 
sessment staff encountered in arriving at their criterion ratings 
which were developed in accordance with Thurstone’s scaling tech- 
niques. It is apparent that, in the words of McNemar again, 
“. .. the prediction predicament rests ona never-resolved criterion 
crisis” (39, p. 860). Although the chief problem which continues to 
confront assessment involves improving predictions from test data, 
the solution depends as much upon a clarification of the behavioral 
event being predicted as it does upon the development of test in- 
struments. What, in fact, is a criterion? Toward what should the 
assessor be directing his prediction? Is his goal to predict “research 
competence,” “supervisory competence,” “good” or “bad” stu- 
dents, etc.? No psychologist is so naive as to assume that the assign- 
ment of a singular term or label to a complex behavior pattern has 
thereby simplified the pattern. Nor can ignorance of the factors 
involved in such complex behavior patterns be compensated for by 
the use of sophisticated statistics. What is required is a more sys- 
tematic analysis of the criterion problem itself, 

Let us consider “research competence.” Certainly knowledge 
of statistics and experimental design are two of the factors involved 
here. But there are additional considerations. Can the candidate 
develop testable hypotheses, can he communicate these adequately 
to others, can he elicit the co-operation of his subjects, can he in- 
terpret his results, can he present his findings to his colleagues, etc.? 
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There are various ways in which some of these factors can be tested 
directly. Thus, effectiveness in communication may well. be meas- 
ured by an evaluation of language skills. But even here itis evident 
that the capacity to communicate is not dependent exclusively upon 
the presence of the relevant skills alone; it is also affected by other 
psychological factors such as reactions to stress, anxiety, control, etc. 
These are factors about which the psychologist also has knowledge, 
and his task therefore is to analyze the job requirements for the 
prospective clinician, student, theologian, teacher, salesman, or iii- 
dustrial executive in terms of all the relevant psychological varia- 
bles. 

The combination of variables thus represented as “research 
competence” does not necessarily constitute a psychological cri- 
terion, however. It is, rather, a standard of performance in a specific 
work situation that some individuals are said to manifest. These 
judgments are made by significant others in their environment. In 
clarifying the psychological variables which are involved in specific 
job activities, the assessor cannot overlook the intra- and inter-per- 
sonal factors which are associated with such judgmental standards as 
well as in the actual performance itself. In one situ 


ation, for ex- 
ample, the research administrator pride 


s himself on the fact that he 
has cornered the market on ideas, He sees himself blazing a new 
pathway in research, and seeks only technicians who will be willing 
to implement the program which he himself h 


as conccived. A sec- 
ond administrator elsewhere, howey 


er, is more concerned with en- 
couraging his staff to develop and pursue their own ideas. He sees 
his task as being primarily one of facilitati 


ng, rather than con- 
trolling, 


the creativity and productivity of others. It w 
apparent that scientists particip 
will have to differ considerably 
“research competence” by the 
tist who has been tra 


ould seem 
ating in two such research programs 
if they are to be regarded as having 
ir respective administrators. A scien- 


ined to think independently 
cerned with the maintenance 


rity is more likely to e 
described than he 


and who is con- 
of his personal autonomy and integ- 
ncounter difficulties in the 


first situation 
will in the second. He is more 


likely to be rated 
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low in “research competence” by the first administrator, not be- 
cause of actual limitations in his knowledge or ability, but as a 
result of the probable interpersonal difficulties which can be ex- 
pected to arise in the course of the relationship between this scien- 
tist and this administrator, difficulties that are almost certain to 
color the administrator's evaluation of the scientist's abilities, 

Adequate predictions of “research competence” in these two 
situations will obviously fail unless the assessor has also taken into 
account the differing psychological requirements entailed in these 
two hypothetical situations. These psychological job requirements, 
stated in psychological terms, are the true criterion. The judgments 
of competence in research made by significant others in the job 
situation are standards of behavior which must be integrated into 
a criterion along with determinations of other aspects of the per- 
formance. 

‘These considerations reveal a hidden dilemma which assessment 
psychologists have hitherto left unresolved. When confronted with 
the task of differentiating between good and poor performers, he 
has ideas of his own as to what “goodness” and “poorness” may 
mean here. He has an extensive body of literature—some specula- 
tive, some theoretical, and some factual—from which to develop 
such ideas and construct appropriate tests. But if the factors he has 
selected are not actually relevant, or if they do not reflect the stand- 
ards employed by the significant judges in the performance situa- 
tion, his work has been for nought. No matter how adequate the 
conceptualization developed by the psychologist may be for a per- 
formance obtained under ideal conditions, unless he gives due con- 
sideration to the question of whether or not these determinants are 
free to operate in the actual job situation he is committing a psy- 
chological fallacy in assessment research. The broader culture may 
not be operating in terms of these determinants, The psychologist 
under these conditions must be a realist. Although he himself must 
necessarily eschew value judgments in developing his notions of the 
criterion, he must accept the fact that the significant others who 
frequently constitute his major source of criterion data themselves 
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operate in terms of value judgments. These must be elicited and 
incorporated in any criterion if it is to prove adequate for assess- 
ment purposes. 

This resolution of the criterion problem, which will be further 
elaborated in subsequent chapters of this book, has emerged from 
the reconsideration on our part of the implicit premises contained 
in a slowly evolving theoretical orientation towards behavior. The 
orientation in question, to which Lewin, Murray, Sullivan, Mul- 
lahy, Cottrell, Parsons, and others have contributed, posits the be- 
havior which the assessor predicts to be a function of transactional 
relationships between the person and the environment. Although 
the formal integration of such a theory has not yet been accom- 
plished, the task is beyond the scope of this present volume. 

The purpose of this book is to clarify four major methodologies 
of assessment—the analytical, empirical, synthetic, and configura 
tional approaches—which take on special significance and utility 
when examined in the light of a transactional theoretical structure. 
These formulations are amplified for the reader by means of a 
series of studies which provide concrete examples of the particular 
kinds of operations entailed by each of these methodologies. 

Although the major theme of this book, then, is methodological, 
there is also a substantive one. In carrying out these research pro- 
jects, specific substantive problems were studicd, e.g., the selection 
of teacher-trainees, the problem of under- and over-achievement, 
etc. While most of the techniques employed in these investigations 
are already well known, there are others which have seen little 
application outside of the present context. It is our hope that the 
combination of methodological and substantive contributions pre- 
sented in this volume will have succeeded in providing a fresh per- 
spective on a persistent problem, stimulating a re-examination of 


current activities in this area, and introducing a vehicle for further 
productive endeavor. 


CHAPTER 2 


Sttuational and Individual 


Determinants of Behavior 


THE FOUR METHODOLOGICAL ALTERNATIVES IN ASSESS- 
ment, referred to previously, all depend upon the theoretical as- 
sumption that behavior is a function of the transactional relation- 
ship between the individual and his environment. We shall attend 
at the outset, then, to a consideration of these situational deter- 
Minants of behavior and the corresponding individual or internal 
frame of reference. A systematic presentation of all significant en- 
vironmental and personality factors, and their interrelationships, 
is beyond the scope of this work. The discussion which follows is 
intended merely to outline the background from which these four 


assessment methodologies were developed. 


Situational Determinants 
of Behavior 


Behavior represents an ongoing field process. It is the resultant 
Of the transaction between the individual and other structural units 
in the behavioral field. For convenience, these other units may be 
referred to collectively as the environment. This environment pro- 
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vides a continual source of actual and potential stimulus demands 
and consequences. It consists of people, institutions, situations, 
tasks, rewards and penalties, as well as numerous factors of physical 
and biological significance. In the exchange between individual 
and environment, both give to each other, and both are affected 
and to some degree altered by the exchange. For assessment pur- 
poses a major first task is to reduce the detail and complexity of the 
situation to more manageable proportions. 

The immediate physical environment provides a variety of stim- 
uli which are of varying significance for the organism. The indi- 
vidual responds to some and is seemingly oblivious to others. In- 
sensitivity to certain distal stimuli may be attributed to limitations 
in receptor processes, with respect to extreme frequencies and in- 
tensities of sound or light, for example. Of greater significance for 
us is the lack of attention the individual gives to particular ele- 
ments in the environment which are otherwise of adequate thresh- 
old value, a situation which occurs because he is actively attending 
to other elements or because he is consciously avoiding particular 
aspects of the environment. Thus, the environment may be divided 
into a figure and ground. Certain aspects are more salient than 
others; these are attended to and require the expenditure of energy, 
while others are given only peripheral attention or none at all. 


Those aspects of the environment w 


hich are significant for the 
determin 


ation of behavior may be conceptualized in terms of what 
Murray (44) has referred to as “press.” The press is sub-divided 


into two major categories: alpha press and bela press. 


Elements in the environment which actually exist and are cap- 
able of affecting the behavior of the participating individu 


al, as 
inferred by a trained observer, comprise the 


alpha press. The prop- 
erties of the alpha press are not limited to those elements which are 


readily observable or which may be reported spontaneously by all 
or even most participants. In fact, the individual's explanations of 


the determinants of his own behavior are not infrequently more 


rationalized than reasoned. Furthermore, certain classes of deter- 


minants may be subliminal with respect to thresholds for conscious 
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verbalization, although nonetheless adequate in affecting behavior, 
as has been shown by Miller (40) and others. Thus, an important 
criterion for representation in the alpha press is the capacity of the 
stimulus to elicit a response or to affect the behavior of participat- 
ing individuals, regardless of the individual subject's awareness of 
its presence or effect. 

Although the alpha press is represented in terms of judgments 
made by the trained observer, we must also recognize the character- 
istics of the press as they are interpreted by the participating sub- 
Jects or subject. When a particular way of perceiving the environ- 
ment is shared by members of a functional group, it is called the 
common bela press and it usually reflects some of the means by 
which the group maintains its orientation to reality. 

Thus, assessors may achieve unanimity in attributing the im- 
Personal preoccupation of the theoretical physicist or mathemati- 
cian with abstract conceptualization as facilitating the withdrawal 
of such individuals from personal interactions and relationships 
Which have been found unmanageable (alpha press), whereas the 
Physicists may be equally agreed that their activity represents noth- 
ing more than a most challenging and rewarding opportunity for 
Speculation and understanding about things which really matter 
(beta press). To be reasonably impartial about this we might note 
that the physicist may conceivably judge the assessor’s press to be 
represented in situations which facilitate extension of an adolescent 
Preoccupation with the characteristics of one’s self (alpha press), 
Whereas the beta press of the assessor may be devoid of such insight. 
Information about the alpha press provides us with material con- 
cerning determinants of behavior as seen by the observer. The 
common beta press, representing the perceptions and meanings 
which are shared by a given group of individuals, is important inso- 
far as the attempt to identify individuals who will exhibit similar 
qualities of performance in a given situation is simplified in part 
by considering subjects for whom the press has similar stimulus 
value, 

Beyond these shared elements represented in the common beta 
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press, however, the individual may also be characterized by more 
uniquely personal responses to certain aspects of the psychological 
environment. Such highly selective percepts of the environment 
which are a function of the idiosyncratic properties of the indi- 
vidual must be further distinguished in the private beta press. The 
qualities of this peculiarly individualized press require extensive 
communication with the subject for their elaboration, They may 
also be more easily recognized in the “aberrant” behavior of the 
subject than by the actual sharing of the percept with another ob- 
server. Delusional states are extreme examples of the divergent 
character of the private beta press. Although analysis of the press 
on this level may be of considerable, if not paramount, importance 
for the most extensive understanding of an individual’s behavior, 
such exhaustiveness is not always essential. Under certain condi- 
tions it will be sufficient for the assessor to have determined the 
properties of the alpha and common beta press, and to have recog- 
nized the mere fact of significant deviation on the part of the indi- 
vidual in his response to these, without necessarily inquiring into 
the precise content of the private beta press for each deviate. To 
probe too deeply into these deviations may well alter the relation- 


ship between the assessor and the subject into a more clinically 
oriented diagnostic or therapeutic relationship. 


CHARACTERISTICS OF INSTITUTIONAL PRESS 


: The preceding comments on press may be applied to any situa- 
tion in which the individual finds himself, Thus, a press analysis 
may be undertaken for an individual’s home, job, club, commu- 
nity, etc. For assessment purposes, however, the press analysis is 
restricted to a particular environment or institution. In the studies 
to be reported later, the specific environments with which we are 
concerned are educational institutions. Before we proceed to a 
discussion of the press involved in these institutions, 


ies one additional 
comment is in order. 


An educational institution is composed of 
sub-units. Although a series of departments may together consti- 


tute a college or university, each of them may differ in terms of 
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the press that they impose upon the individual. Furthermore, as 
the individual progresses in his development in a particular envi- 
ronment he is exposed to press that differ in both quality and in- 
tensity. Therefore, in assessment practice it is necessary to restrict 
oneself to that period in time for which there are no major or sharp 
breaks. To be sure, the time span selected must be sufficiently broad 
to make the time and effort invested in the assessment activity 
worth while. Consequently, in the situations we have studied we 
have restricted ourselves to educational settings in which the press 
on the individual was regarded as relatively consistent in character 
Over a period of time. The obtained results do not, therefore, refer 
to assessment for professional practice in any of the fields we have 
considered, being restricted to student roles only. 

With this in mind, let us turn to a discussion of our conception of 


the press involved in the settings we have studied. 


Goals and Purposes. Institutions are developed and exist in order 
to achieve a variety of goals and purposes. Once these have been set 
up there are a series of requirements which individuals must fulfill 
if they are to be selected for participation in the organization and 
are to be permitted to continue with their affiliation. It is for this 
reason that an attempt is made to clarify the goals and purposes of 


the institution. 
The goals of an institution can be determined on the basis of 


information gathered from key persons who have had and still have 
a hand in developing them. However, educational objectives are 
frequently stated in relatively vague and abstract terms. Even the 
formulation of an objective in precise words does not necessarily 
mean that the manifest or literal content of the statement is to be 
considered a valid aspect of the press. The genuine demands which 
confront participants in the situation are reflected in the actual 
practices which characterize the interaction process. The types of 
tasks in which the student must engage, the typical relationships 
which prevail between faculty and student, the behavioral trends 
which are consistently permitted or encouraged, define the true 
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purposes of the institution far more clearly than the overt verbaliza- 
tions concerning programmatic objectives which may or may not 
have been translated into relevant activities. The distinction here 
parallels that which holds between the alpha and bela press Ims 
plicit objectives are represented by the actual practices of the insti- 
tution, although they need not be given overt recognition or con- 
scious verbalization. Explicit objectives refer to formal statements 
of purpose which may or may not be reflected in actual behavior. 
The employer who emphasizes efficiency and skill as characteristics 
of preferred clerical workers may easily mislead his personnel de- 
partment into adopting tests of typing speed and stenographic skill 
for prospective employees. If in fact, however, promotions and 
tenure have gone more frequently to the attractive and personable 
clerk, regardless of initial clerical aptitude, the predictive utility of 
assessment becomes minimized. In the case of educational institu- 
tions, selection based on scholastic aptitude and intelligence may be 
of minor relevance for a faculty which tacitly considers docility of 
manner and social poise more important student attributes than 
intellectual capacity as such. 

When educational objectives are formulated in terms of the 
behavior expected of students, and when these are further opera- 
tionally defined in terms of the kinds of evidence 
for the purpose of evaluating student achieve 
tives, institutional purposes and practices are more likely to coin- 
cide. Such objectives help determine the kinds of re 
teachers and students, teaching procedures and 
subject matter and learning materials, a 
expectancies w 


to be gathered 
ment of these objec- 


lations between 
student reaction, 
nd in general, define the 
hich become translated into action in a curriculum. 
It is also possible, however, for means and e 
with one another. Under extreme circumstances, actual practice 
(implicit objectives) may completely nullify the explicit objectives. 
An institution may be inconsistent with its explicitly avowed pur- 
poses, although obviously not with its implicit objectives. 

In the case of educational institutions, experience su 
sible discrepancies between the stated objectiv 


nds to be at variance 


ggests pos- 
es of a school and the 
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procedures actually employed in the classroom. No verbal insist- 
ence on the development of independent thinking, for example, 
can alter the outcome of a scholastic program which emphasizes 
fixed and doctrinaire standards of judgment and early apprentice- 
ship to a faculty concerned with molding students to orthodox pat- 
terns. Encouraging independence of thought, in the sense of capa- 
city to go beyond prior frames of reference including that of the 
institution, cannot be accomplished by pedagogical procedures 
analogous to the “mug and jug,” where the teacher represents the 
fount of knowledge and the student the yawning receptacle, or the 
“potter and clay,” where a somewhat more plastic student is shaped 


to a standard form. 


Cognitive Processes. The most frequently encountered objectives 
in school settings, from secondary to graduate school, involve in- 
tellectual attainment. Such objectives attempt to make explicit 
those aspects of intellectual growth and development which are 
Considered to be the desired consequences of particular courses or 
Programs of study. Although such objectives may be formulated in 
terms of achievement in specific subject matter areas, statements 
which reflect underlying intellectual processes are of greater psycho- 
logical significance. A taxonomic scheme such as that recently de- 
veloped by a group of professional examiners (5), can be most 


useful for this purpose. 


Affective Processes. Another set of educational objectives which 
are of influence in learning press are those which may be regarded 
as falling in the affective domain. These involve most generally 
some affect or emotion which is related to a view or mental process, 
including attitudes and opinions, values and appreciations, inter- 
ests, and adjustment. Such learning outcomes are often not so much 
the result of specific subject matter and particular learning activi- 
ties as they are the result of less conscious means of communication 
between faculty and students. Thus, nothing may be said explicitly 
about the kinds of interests students are expected to achieve in the 
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arts and music, but this may be transmitted quite effectively in the 
ways in which a faculty member may speak about his field, the 
tone of his voice, and perhaps even the kind of artistic and musical 
activities in which he, personally, engages. Emotional orientation 
may also be communicated through student leaders more sensitive 
than others to the model presented by the faculty members. 

No systematic classification of affective processes is currently 
available, due in part to the relative scarcity of explicitly formu- 
lated objectives in this area. This seems not unrelated to the re- 
cency with which such functions have been recognized as legitimate 
aspects of the learning situation. As has been pointed out else- 
where (cf. 55), schools as well as industry appear to be participating 
in a trend which involves a de-emphasis of intellectual and techni- 
cal skills, and an increasing stress upon interpersonal matters. Such 
objectives have not yet achieved explicit formulation, although 
they appear to be conveyed implicitly to the student by relatively 
informal means in many situations. 


Institutional Roles, Practices and Values. Within an institution 
there are values which people may assume, as well as practices de- 
termined by both tradition and purpose. In a church there are 
definite roles assigned to the clergy as distinct from those assigned 
to the laity, and each is expected to observe relatively well-defined 
practices. In a business there are roles and practices assigned to the 
stenographer, the foreman, and the executive. Likewise, in an edu- 
cational institution there are roles assigned the student and the 
teachers. These may differ from school to school, and even within 
the same schuol. 

The teaching procedures used in a school serve to define the 
a pase roles, and have much to do with determining the 
activities expected of both students and te ing 
procedures often follow from the ate dine, ede 
where: a faculty is clearly cognizant of the tiplications: of these 
objectives and is trying to implement them in all of its work. 

The intimate relationship between formal objective and pro- 
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cedural implementation may be found in a comparison of lecture 
versus discussion methods of teaching (3). In the lecture situation, 
an authority presents information or a view of a particular matter 
which is to be internalized by the passive recipient of the communi- 
cation. Closely allied to the lecture method is the recitation class 
where students are, for the most part, required to demonstrate 
their knowledge or understanding by formulating it in a manner 
acceptable to the instructor. Psychologically this may require more 
activity on the part of the student but, in our view of the case, it still 
represents the relation between a superordinate authority and a 
subordinate learner. In the case of the recitation the authority is 


inquisitor as well as judge, whereas in the lecture situation the 


authority is merely presenting something which the students are 


required to absorb and retain. The discussion section, on the other 


hand, represents an attempt to provide a setting within which a 


co-operative group attack upon a problem regarded as significant 


by the group is made possible. 
Thus, the learning methods or classroom procedures may be 


distinguished in terms of the number of students involved and the 
kind of activity in which students are expected to engage, and may 
vary from extreme passivity, individual participation when re- 
quired, to spontaneous participation elicited by involvement in a 
common problem. These aspects of the press may be studied quite 
directly by observing the teaching and learning situations used, by 

teachers and teaching 


securing student reactions to particular 
ibe the methods of 


methods, and by asking the teachers to descr 


instruction they employ. i 
Another institutional practice which helps define the press is the 


material which the student is expected to use. Such learning 


material may encompass textbooks, in which everything that is to 


be learned is made explicit to the student, as well as problem 


materials, primary source data, and demonstrations, representing 


not so much the things to be learned in themselves as materials to 


P ont r hus, a particular humanistic 
be used in the learning process- T. P 


work, e.g., a Shakespearean tragedy, may be considered as some- 
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thing for the student to read and remember, or it may serve as a 
source of problems to be understood, analyzed, and eyaluated The 
former approach is often considered more congenial and easier by 
some students, whereas the latter is likely to be regarded as more 
challenging and interesting by others. Learning materials may be 
subjected to direct analysis by a competent observer, or studied 
indirectly through the student reactions secured during and after 
the learning process in which they were involved. 

The contents of the various subject matters represent another 
aspect of the press in learning situations. However, it is important 
to distinguish here between superficial distinctions and those of 
genuine psychological significance. All subject matters become 
psychologically equivalent when the objectives and procedures 
demand similar types of achievement in each area. Thus, the social 
and biological sciences are not differentiable sources of press if the 
student is required to reproduce similar units of information in 
both. The rote organization of detail may be emphasized to the 
same degree in both areas, despite the variation in the specific 
social or biological phenomena which are so organized. 

However, it seems likely that the humanities and social sciences 
in general involve greater ambiguity and abstraction than would 
ordinarily be true of the somewhat more concre 
clearly structured phenomena char 
biological sciences. Thus, the 


te, tangible and 
acteristic of the physical and 
subject matter may be viewed in 
terms of theoretical versus practical 


» verbal versus quantitative, 
value ve 


rsus fact, or symbolic and abstract versus concre 
again, a direct analysis of the 
content is readily available, 
tion concerning the selectiy 
on students. 


te.. Herë 
press from subject matter and course 
as well as indirectly through informa- 
e influence which such materials exert 


Rewards and Penalties. Each institution h 


and penalties which serve to define the pres 
secure compliance with the institutional d 
quite subtle and not explicitly codified, 


as a system of rewards 
s and which are used to 
emands. These may be 


Thus, access to group 
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Participation and social interaction may be the primary form of 
approval and acceptance accorded the individual by his peers and 
by authority figures. On the other hand, the rewards may be for- 
malized and well-defined, as in the case of salary schedules, ranks 
and offices, etc. The penalties may also be subtle and represented 
by only the slightest of cues, or they may be openly specified in the 
form of disciplinary measures and even exclusion from the group. 
In educational institutions the most explicit rewards and penal- 
ties are represented by the grading systems. These are highly codi- 
fied and are assigned on the basis of performance and activities 
which are relatively clearly communicated to students. Other, less 
easily defined criteria for rewards and penalties have to do with the 
approval and disapproval of the student by both students and 
faculties, Furthermore, parents and guardians also do much to 
reinforce and support the institutional reward and penalty system. 
When the judging procedures are based largely on examinations 
Which are graded in an objective manner, without specific knowl- 
edge of the identity of the student, the grading system and its effect 
as a press on the student can be studied quite directly and quanti- 
tatively. Here the explicit objectives of the institution may be 
revealed with clarity. Where, however, grades are based wholly or 
in part on the teacher's subjective evaluation of each individual 
Student, the press is more difficult to determine and includes both 
implicit and explicit objectives of the ad To the extent 
that highly personal interactions enter into the ratings of students, 
the press may need to be inferred from analysis of the internal 
frame of reference of the teachers and their implicit objectives. 


The Person and His Internal 


Frame of Reference 


The preceding section has emphasized pervasive aspec at edu- 
Cational situations we have studied which press upon individual 
Participants, regardless of their own unique attributes, and exert 
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an influence upon their behavior in such situations. The material 
covered is the alpha press—defined by us as observers. This brief 
treatment, however, represents but the barest beginnings of the 
critically important elaboration of dimensions in psychological 
fields. For we must agree with Murphy that “a study of situations 
that act upon persons should be at least as full and as systematic as 
is a study of the internal structures which respond to these situa- 
tions” (43, p. 877). 

It is the study of the “internal structures”—the individuals—that 
will provide us not only with data regarding the individual's per- 
sonality in a variety of areas, but also the characteristics of their bela 
press. Those aspects of the press which are reflections of the sub- 
jective state of the participant acquire their unique meanings as a 
result of experiences gained from previous situations in which the 
individual has engaged. Thus, in studying the individual, the as- 
sessor is faced with two complementary tasks. The first is a diag- 
nostic or “understanding” function: how did the subject get to be 
the way he is? The second function is predictive: how will the sub- 
ject interact with specified press in the immediate or more distant 
future? 

In order to fulfill these two functions some theory of personality 
is required. Typically, such theories direct attention to the past 
history of the individual, his learning 


significant interpersonal relationships, 
needs, 


patterns, critical trauma, 
his present hierarchy of 
his values, aspirations for the future, etc. The purpose of the 
elaboration to be presented here is not to constr 
personality, but to discuss the major points w 
ful in guiding our attempts at underst 


uct a theory of 
hich were found use- 
anding the individual. 


MAN IS A BIO-SOCIAL BEING 
Man starts off in life with certain congenital predispositions. 
Their precise nature and effects are not completely clear 
ent time. However, studies such as those sum 
indicate that significant individual differen 
children as early as the immediate post- 


at the pres- 
marized by Ribble (49) 
ces are to be found in 
natal period. Fries and 
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Woolf (23), for example, have described a number of activity pat- 
terns in groups of newborn infants, suggesting that the factors which 
make for differences in energy level may be laid down early in life. 
In addition to these congenital influences and their constitutional 
effects, which Sheldon (56) believes are also related to enduring be- 
havioral trends, the influence of endocrinological factors and vis- 
cerogenic needs on personality must also be considered. Man is 
motivated by a variety of such viscerogenic needs, dominating the 
early years of life. However, since the child does not possess the 
wherewithal to satisfy his needs and is dependent on others for their 
satisfaction, man starts off in life and remains a social animal. In 
the course of this social transaction new patterns of behavior ap- 
pear. The consistency of these secondary patterns leads us to infer 
the presence of psychogenic needs which have a function in the 
Motivational system in many ways quite similar to the viscerogenic 
needs, 


SOCIALIZATION AS A LEARNING PROCESS 

In the course of attaining satisfaction for his early viscerogenic 
and psychogenic needs the child lays the foundation for his future 
behavior. The development process is a learning process whereby 
the child, in the course of his development, learns who or what will 
Satisfy his needs and who or what will frustrate or deny them. He 
also learns which of his behavior patterns are accepted, rewarded, 
Or punished by others through a process which Sullivan has called 


Consensual validation (68). In short, the child learns to adjust to his 
t this means learning to 


t are brought to bear on 
control his needs and 


external environment. To a large exten 
adapt to the environmental pressures tha 
him. As he develops and grows, he learns to c 
to delay his desire for immediate satisfaction. He learns that he must 
¢stablish higher thresholds for tolerating internal pressures. This 
is manifest in eating “on schedule” and in better bladder and 
sphincter control. Thus, the child’s development is accompanied by 


what L. K. Frank has described as a broadening in time perspective 


or, as Freud has put it, the maturing adult shifts from adhering to 
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the pleasure principle (in terms of which one’s needs ame granted 
immediate satisfaction) to a reality principle (where an individual 
is aware of and takes into consideration the consequences of his 
behavior before embarking upon a specific course of action). 

Not only are there “schedules” to conform to, but bigger and 
more powerful persons whose attempts to satisfy their own needs 
must also be considered by the child. Consequently, the develop- 
ment of physiological maturity is accompanied by a simultaneous 
development of psychological and social maturity. The child learns 
how to get along with others—parents, siblings, and similar signifi- 
cant figures—in his environment. He learns where and how he has 
to conform to their wishes, as well as the circumstances and modes 
in which to express his own individuality. 

Another significant factor in the socialization process involves the 
selection, from the immediate environment, of models of behavior 
that may be copied and followed as well as others that are to be re- 
jected. In terms of psychoanalytic theory one might say that the 
individual identifies with some of the persons in his environment 
and egotizes their behavior while he rejects others. 

In addition to the specific behavior patterns to which the child 
is exposed in his immediate environment, he is also subjected to a 
broader range of value systems and attitudes. Parents are culture 
bearers. They, while the child is maturing, are constantly interact- 
ing and communicating with the broader social environment out- 
side the home. The parents, older siblings, etc., bring into the home 
discussions of the situations they have encountered outside and 
their reactions to them. The child thus has the opportunity to 
develop attitudes toward the outside world even before he comes 
into contact with it. He may well act on these expectancies when 
he makes his first ventures outside. The significant adults in the 
child’s environment not only bring the outside world into the 
home, but they also, in terms of the results of their own experiences, 
stress certain values in the home. Thus, for example, factors regard- 
ing social status and mobility may be emphasized by some parents, 
and the child may be influenced to accept or reject these attitudes. 
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Additional models of behavior patterns, from which he can select 
elements for himself, are highlighted in this way. He can observe 
how his father has reacted to situations outside the home and he 


may wish to model himself after his father. Consequently, he may, 
ations outside the home attempt to solve 


father’s behavioral patterns, rather 
observer from an external frame 


on his first series of explor 
his problems in terms of the 
than any others which an objective 


of reference might think are available to the child. 
s experiences and learning op- 


egins to apportion his energies 
eeds. The child, and the later 
ne and energy to some ac- 


As a consequence of his numerou 
portunities in the home, the child b 
toward the satisfaction of his various n 
adult, devotes a good portion of his tir 
livities and a good deal less time and energy to others. We judge 
from this that the individual develops, consciously or uncon- 
sciously, a hierarchy of activities. And because there must be a 
driving or motivating force for these activities we say that the in- 
dividual has a hierarchy of needs which may be inferred from his 
differentially cathected activities and objects. The basis for the 
hierarchy may be found in the individual's history, and its dynamics 
ted with the individual's means of estab- 


oY purposes may be associa 
wn integrity and security 1n society. 


lishing and maintaining his 0 
N BEHAVIOR 

vidual in the course 
pressures from his 


ORGANIZING FACTORS | 


The Self-Concept. As indicated above, the indi 
1 to a variety of 


of his development is expose 

environment and he learns how to adjust or adapt himself to these 

e he behaves in a social environment he is 
ns of others and, by implication, their 

Their evaluations serve as “feedback” 

vidual not only may alter his behavior 


f himself. 
hed may come to 


Pressures or press. Sinc 
also exposed to the reactior 
evaluation of his behavior. 
on the basis of which the indi 
Or reinforce it, but also develop 4 picture o 

Thus, the child who is constantly being punisl 
consider himself as really bad (rather than misunderstood, for ex- 
ample)—‘everyone else thinks I am bad so I must be bad”—and 


develop as a result into a guilt-ridden adult. Or the child who is 
49 


Methods in Personality Assessment 
given complete freedom and immediate satisfaction for his needs 
may develop omnipotent ideas about himself—“I am a powerful 
figure, for all I do is cry and there is someone around to feed, coddle 
or diaper me’’—and thus become in time an egocentric adult. 

The self-concept, as a construct, attempts to express an under- 
lying theme or unity of organization in personality. It provides the 
key for discovering consistency in what may otherwise appear to be 
diverse and unrelated behavioral episodes. Thus, feelings of in- 
feriority may account for an individual's withdrawal from contact 
with others, the self-limiting scope of his activities, his depression 
in competitive situations, acceptance of punishment, etc., etc. Al- 
though the relatively enduring total configuration may be con- 
sidered simply as a structure of happenings, it has been helpful to 
focalize this structure in terms of the individual's own definition of 


“the nature of that totality which he is” (42, p. 1), i.e., his self-con- 
cept. 


Conception of Others. The abstraction of elements from the inter- 
action with others is not limited to the development of the in- 
dividual’s self-concept, but also serves to provide a concept of others 
in terms of which behavior is organized. Thus, new individuals may 
be responded to on the basis of expectancies derived from prior 
interactions, despite the lack of objective identity between persons 
figuring in the earlier interactions and those in the new. Subjec- 


tively, however, the responses elicited by previous figures, such as 


the parent, are transferred to new ones, such as the teacher, without 


regard for their genuine relevance or appropriateness. Such idio- 
syncratic generalizations in the perception of others have been 
termed parataxic by Sullivan (68). 


i Only as the course of interaction 
continues, 


; and is subjected to consensual validation, can the re- 
sponding individual gather the necessary additional information 
on the basis of which his concept of others may be altered 


Conscious and Unconscious Motivation. Several levels of explana- 
tion may be involved in accounting for 


i the mainsprings of behav- 
ior, both with respect to the extent of th s 


e individual’s awareness of 
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his own motivation as well as the particular needs which are being 
satisfied. The manifest behavior of an individual may involve his 
domination of a subordinate. The underlying “explanation” of his 
manifest behavior requires the exploration and resolution of a 
considerable number of factors, however. 

Such behavior may reflect a realistic evaluation of situational 
forces which call for dominance. On the other hand, such behavior 
may be employed as a protective device: the relegation of others 
to subordinate positions serves to compensate for pervasive feelings 
of inferiority. Conversely, passive behavior with regard to others 
may be utilized by the individual as a defense against his own un- 
derlying hostility, the expression of which might be considered 
dangerously uncontrollable. 

The manifest behavior need not depend, of course, on needs of 
which the individual is totally unconscious. The individual may be 
aware of certain strong tendencies in his own personality, but not 
give them free expression. Thus, submissiveness in the presence of 
a superior may be accompanied by recognized feelings of hostility 
which remain unexpressed for a variety of reasons. In this case we 
must refer to latent behavior, of which the individual is wholly 
aware, but which differs markedly from the way in which he actu- 
ally behaves. 

Ideally, the assessor would like to know, with regard to any spe- 
cific pattern of behavior, to what extent the subject is aware of the 
psychological factors determining his behavior and whether such 
factors will be latent or will actually appear in manifest behavior. 
Each of the possible alternatives here is accompanied by differential 
predictions for the future. Furthermore, shifts in environmental 
forces will alter the state of such behavioral determinants. Men 
who have been quite submissive at home may become extremely 
assertive once they have escaped the ruling hands of the parents. 


PERSONALITY AND SOCIAL ROLE 


The preservation of a given society over a period of time re- 
quires that various diverse functions be assigned to different in- 
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dividuals and transmitted from one generation to the next. In busi- 
ness there is the role of the executive, the role of the financier, and 
the role of the worker, to mention only a few. In the family there 
is the role of the parent, the role of the child, and the role of the 
sibling. As an individual matures, the nature of his roles change— 
in quality and quantity. The role of the infant is replaced by that 
of the child, the child's role is replaced by that of the adolescent, 
and so on. But concurrent with this increase in complexity is an 
increase in numbers. The individual also finds that at each suc- 
ceeding stage in his life he must assume several new roles—that of 
a member of a family, as well as a pupil, newsboy, gang member, 
etc. Life becomes more complex, and the multiplicity of roles re- 
quires a certain amount of flexibility on the part of the individual. 
He has to be able to shift between roles. On the adult level it may 
mean that the individual is the subordinate worker on the job and 
the superior figure at home. It is expected of the individual that he 
carry off all his roles with equal effectiveness. However, experience 
in one role may well affect an individual's capacity to function in 
other roles. The father who finds his job role 
home and becomes the domineering or 
is in no frame of mind to deal w 
Thus, stress can be created in t} 
he has to fulfi 


frustrating comes 
submissive father figure who 
ith his family’s needs and problems. 
de individual by the variety of roles 
ll. The assessor must determine whether the subject 


possesses the flexibility to shift between his roles in response to the 
various demands that will be made upon him. 


But there is another significant factor in the matter of roles— 
does the subject possess the necessary personality requirements to 
fulfill the demands of his roles? The role of the student under or- 
dinary conditions involves some degree of readiness to accept di- 
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manifest independence of thought, functioning autonomously 
among others. In this case excessive dependency needs may miti- 
gate against effective role-fulfillment. Furthermore, the synthesis of 
both functions in the same individual requires not only that the 
student have capacities to function in each of these aspects of the 
role, but that he also be sufficiently sensitive to discriminate be- 
tween situations which demand shifts from one form of response to 
the other. In this connection it becomes important to determine 
whether the carrying out of role functions is done with ease and 
economy of effort, or if it entails the expenditure of a considerable 
amount of energy. In the latter case additional increments of stress 
may disrupt the student’s capacity to continue to fulfill the role de- 
mands effectively. 

This completes the outline of factors involved in determining the 
subject's internal frame of reference. Thus far the need has been 
stressed for considering potential behavior from two vantage points 
or frames of reference, the one emphasizing situational determi- 
nants of behavior reflected in an analysis of the context within 
which performance is manifest, the other taking as its point of de- 
parture the internal needs and capacities characterizing the in- 
dividual. Behavior is a resultant of the transaction between person 
and situation; both must be taken into account in attempting to 
predict a potential transaction. It is no more possible to predict the 
behavior of an individual in a situation without referring to the 
situation, than it is to predict the behavior of an individual in ac- 
tion without considering the conditions under which this action 


will be made manifest. 


The Integration of Situational 
and Personal Determinants of Behavior 


The psychological press has been described as a composite of 
what appears to be objectively present, as well as what the individ- 
ual feels subjectively to be significant. These subjective meanings 
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are in turn dependent upon the internal frame of reference which 
characterizes the individual. The prediction of performance is 
based upon a study of the congruence between the environmental 
press and the individual’s personality. E 

To facilitate the integration of environmental and individual 
material we have found it useful to unify the data on environmental 
press in terms of a psychologically meaningful restatement of social 
roles and role-fulfillment. The most important contributions to the 
concept of role have stemmed primarily from sociological analyses. 
The role of the schoolteacher has been described by Waller (78), 
Whyte (81) has provided us with a description of the waitress, and 
Hughes (30) and his students have explored such diverse roles as 
the janitor, the jazz musician, the osteopath, the hospital attendant, 
and so forth. These analyses in general tend to stress two kinds of 
implications, both involving the adaption or socialization of the 
person within the framework of the defined role. On the one hand, 
there are the expectancies of others with respect to adequate role 
fulfillment, which must become internalized by the performer if his 
performance is to be successful. The schoolteacher must learn to 
inhibit or suppress her impulses towards sex or play, the doctor 
must maintain an impersonal detachment from his patient, etc. At 
the same time, certain physical aspects associated with the per- 
formance itself are suggested as reinforcing some behaviors and ex- 
tinguishing others; e.g., the teacher, in order to control her class 
must learn to speak clearly and loudly. In this case the stereotyped 
expectancies of others are not involved, but in either event the be- 
havior of individuals cast in the same role becomes more and more 
uniform with time. 


The view of role offered by the sociologist tends to suggest a some- 
what passive participant who becomes adapted to an externally im- 
posed set of circumstances. We should be limited in this case to 


specifying the particular set of conditions to which the individual 


must adapt himself, but we would be unable to predict whether oF 
not he would in fact conform to these demands. 
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There has been a shift in emphasis introduced quite recently by 
a number of more psychologically-oriented investigators which 
helps to resolve this problem. Beginning with Anne Roe’s (52) 
studies of personality configurations characterizing various scien- 
tists and artists, several pieces of research which stress the personal 
and characterological factors associated with social role functions 
have begun to make their appearance. Henry (28) has described 
the business executive from this point of view, as have Stein et al. 
(60) for the industrial research worker, and Stern (65) for the theo- 
logical student. Perhaps the most thorough attempt toward inte- 
grating aspects of a particular social role with the psychodynamics 
of individuals who gravitate towards it has been made by Kubie 
(35, 36) in his analysis of the scientific career. 

In these cases we can begin to see something of the continuity 
between early socialization and emergent needs which become ca- 
nalized, subsequently playing an important part in directing the 
individual towards the selection of certain careers. It becomes pos- 
sible to structure the problem of interaction and prediction in 
terms of the congruence between needs which the individual is 
internally motivated to work through in behavior, and situational 
press which provide implicit sources of resolutions for such needs. 

Therefore, a psychologically functional analysis of the roles with 
which we were concerned was undertaken. By a psychologically 
functional analysis is meant the translation of the varieties of press 
in their implicit and explicit manifestations into statements of role- 
fulfillment in terms of the needs or personality characteristics which 
are required for most effective functioning. Thus, the same psy- 
chological terms are utilized to characterize the individual as well as 
the environment. The variety of personality factors involved in the 
functional analysis of the role probably varies with the complexity 
of the situation in which the individual finds himself. We might 
anticipate further studies to show sharply discriminable need pat- 
terns among the various professions. 

In the chapters that follow the functional analysis of the role is 
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regarded as the hypothetical model or criterion with which individ- 
ual candidates are to be compared. The various methods utilized in 
the derivation of this model, and techniques for studying the in- 
dividual in his relation to it, are described and illustrated in the 
context of specific research projects. 
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CHAPTER 3 


The Analytic Approach 


IN THE PREVIOUS CHAPTER SOME OF THE MAJOR FAC- 
tors in the environment, the individual, and the integration of 
the two have been sketched. Starting with this chapter a series of 
four assessment methodologies are discussed and illustrated with 
specific research projects. All four methodologies are based on the 
proposition that assessment can be conducted most adequately and 
accurately if attention is paid to both the individual and the en- 
vironment in their transactional relationship. The four method- 
ologies differ in the manner in which they arrive at the criterion 
model and in the type and range of techniques utilized in studying 


the individual and his environment. 
The first of these four methodologies—the analytic—is based upon 


the most thorough elaboration of a transactional orientation, and 
is in fact the fundamental paradigm from which the other three 
methodological alternatives can be derived. The analytic design 
involves several stages. It begins with a thorough situational analysis 
based upon the observations of the assessment staff aided by the 
faculty or significant others, from which the functional roles are 
clarified. A criterion is derived from this material by translating the 
functional roles into descriptive personality models of hypotheti- 
cally effective performers. This is followed by a selection of tests on 
the basis of which the personalities of the individuals to be assessed 
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are diagnosed. Finally, assessment staff conferences are held in 
which data from the analyses of environment and individuals are 
integrated and predictions made. 

These stages will be developed more fully in the remainder of 
this chapter. Description of the psychodiagnostic instruments and 
conceptual schema utilized by our assessors in the two analytic re- 
search projects that follow this chapter have also been inserted at 


appropriate places in the present chapter so as not to distract the 
reader as he reads the assessment studies themselves. 


Situational Analysis 


In analyzing the psychological conditions which underlie per- 
formance, it has been customary to consider such self-evident and 
explicit criteria as are represented in the formal statements of ob- 
jectives enunciated by a faculty or supervisory staff. As has already 
been noted, however, conscious verbalizations concerning the in- 
stitutional objectives and structure are not necessarily reflected in 
the actual process of interchange between participants in the situa- 
tion. Actual criteria of performance must be sought in the implicit 
procedures which characterize prevailing interpersonal relation- 
ships. In practice, inferences concerning the press in learning situa- 
tions may be drawn from direct observations of the relations be- 
tween teachers and students, as well as by analysis of the judgments 
which students make about teachers and the curriculum and the 
corresponding judgments of teachers about students. 

In the particular cases which are elaborated in Chapters 4 and 5, 
understanding of the psychological press was obtained largely by 
means of interviews with the faculty. Group and individual dis- 
cussions with key faculty persons were held, following the general 
pattern of an anamnestic psychiatric interview, for a total of twelve 
to fifteen hours, over a period of weeks. The faculties were induced 
to discuss academie problems freely and spontaneously and to il- 
lustrate thei points with descriptions of specific behavioral inci- 
dents. During the initial phases of such discussions only broad and 


58 


The Analytic Approach 


relatively ambiguous questions were raised by the assessors, the 
faculty being stimulated to structure the session in its own fashion. 
At this point we were interested in the spontaneous expression of 
the group, the range of topics discussed, the relative emphasis 
placed on each, areas of perseveration and tension, and the intensity 
of expression and accompanying emotion. 

This phase of free-flowing production usually lasted for six to ten 
hours before the assessors felt that a point of diminishing returns 
had been reached. Following this, more structured probing was 
introduced, exploring the limits of issues introduced by the faculty 


as well as problems raised in conjunction with student interviews 


and participant observations made by the assessors during the pre- 
ceding period of time. From these discussions with key faculty, in- 
red concerning the nature of the identifications 


formation was secu 
s in which they perceive them- 


the staff makes with students, the way 
selves, the students, and the teaching situation, and the expectations 
the staff holds with respect to adequate student performance. 

ideal student obtained in these instances 
all members of the respective 
gely to the homoge- 


The conception of the 
proved to be fairly uniform, shared by 
faculties. This was, of course, attributable lar 
avolved and may be atypical. In larger pro- 
grams a multiplicity of such ideals, each representative of some 


particular faction, would seem more likely. The simultaneous exist- 
rather than one, involves no significant 


ng described here, however. 
ystem of expectancies shared 
dent must fulfill more or 


neity of the small staffs ir 


ence of a number of ideals, 
modification of the procedures beir 
We are dealing at this point with a s 


by the faculty which define the role a stu 
s to be recognized as adequate. It is the yard- 


tudent performance is evaluated by the 
e is limited for the most part to ex- 


pectancies regarding concrete modes of behavior characterizing 
interaction between staff and student, but it can also encompass 
riteria such as intellectual capacity, physical 
alth, family background, etc. The influence 
wever, to determining 


less effectively if he i 
stick by means of which s 
faculty. The content of the rol 


significant impersonal € 
appearance, physical he 
of these latter criteria seems restricted, ho 
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entrance qualifications to the competitive race. They are significant 
insofar as individuals without such qualifications are unlikely to 
even be given the opportunity to demonstrate their capacity to ful- 
fill faculty expectations. The extent of qualification beyond the 
minimal standards involved is of minor importance hereafter, un- 
less particular conditions in the press place a premium on them, ¢.g., 
situational requirements involving exceptional skill in problem- 


solving or logical thought, physical stamina and endurance, or the 
like. 


DERIVATION OF A CRITERION: THE HYPOTHETICAL MODEL 


For the assessment team, the role constitutes the source from 
which a criterion for assessing individuals is obtained. The success- 
ful fulfillment of the role implies a particular configuration of 
personality, representing the kind of individual most likely to be 
characterized by behavior which is relevant to the specified role. It 
is this configuration, referred to as a hypothetical model, which can 
be couched in terms that are the direct counterpart of evidence to 
be obtained from psychodiagnostic techniques. In other words, the 
hypothetical model is an inductive system obtained from systematic 
examination of the requirements posed by the role previously for- 
mulated. It is a description of the type of person who can play the 
role, spontaneously and characteristically. 

The primary function of this translation from role to model is 
to provide a clear criterion for the assessment of individuals which 
is directly related to the kinds of information to be secured from 
the candidate. The underlying personality configuration thus de- 
rived is a stable and consistent system, from which future behavior 
in specified situations can be readily inferred. Specific traits or ele- 
ments represented in the original role formulation involve particu- 
lar behaviors which are possible perhaps to most people, but which 


are not necessarily spontaneous or typical responses for many per- 
sons under the specified performance conditions. 


The role itself can serve as a criterion only under relatively ex- 
ceptional circumstances. Measures of its components can be ob- 
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tained directly by observing the actual participation of individuals 
in the situations which are relevant to the eliciting of this role. Since 
these situations cannot be provided ordinarily (it is this very situa- 
tion for which the prediction is being undertaken), the assessor is 
limited to attempts at reproducing essentially similar test situations. 
Under the usual circumstances of administration these remain test 
situations, however, providing restricted samples of behavior. In 
addition, data obtained under these conditions are contaminated to 
an unknown degree with possibly atypical responses as well as at- 
tempts at evasion, concealment, or artificiality. The reduction of 
error from this source is not insurmountable, but does involve 
time-consuming duplication and extension. 

The best test of a foreman, for example, is to give the individual 
the job and evaluate his performance after a period of time. Where 
this is what is to be predicted, however, it does not necessarily follow 
that an attenuated performance on the job will prove to be an ade- 
quate basis for estimating long-term effectiveness. The attenuated 
performance, as a result of its specificity, cannot provide a sufficient 
Picture of behavior to fulfill the requirements of prediction. The 
hypothetical model, on the other hand, involves the xepresentation 
of potentials which underlie relevant and characteristic beliavioral 
responses. Furthermore, techniques for assessing the individual's 
internal frame of reference involve inferences from behavior which 
is not the direct equivalent of actual role pénletnaatinn, thus reduc- 
ing the possibility of deliberate distortion by the subject. 


Psychodiagnostic Testing 


Obtaining evidence concerning the subject’s peisonality pattern 
requires the use of clinical techniques for estimating the subject's 
internal frame of reference. These techniques yield data from 
which a picture of the individual may be constructed, and which 
may be compared directly with the hypothetical model. The degree 
of congruence revealed by this comparison serves as the basis for 
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predicting a student's potentiality for adequate tolefullitiment; 
more specifically, it permits prediction of the likelihood that a 
given student will be recognized as superior by the faculty con- 
cerned. ies 

The psychodiagnostic test procedures or techniques utilized in 
obtaining information regarded as relevant for assessment purposes 
involve essentially a social situation in which the assessor and sub- 
ject communicate with each other in a special kind of atmosphere. 
The subject, when he comes for his examination, comes with certain 
attitudes and expectancies regarding the test situation. He may, for 
example, feel threatened by the examination, or he may feel that 
this is a competitive situation in which he must demonstrate su- 
perior ability, or he may react spontaneously. There are persons 
who may try to play a specific role, or attempt to convey to the 
examiner a certain picture of themselves, which is not necessarily 
typical for them. But the examiner does not want this picture alone, 
although of itself it may be a revealing datum of the subject's per- 
sonality. He does not want the subject to select the facts, but he 
wants all the facts concerning significant events, and the subject's 
feeling concerning these facts and events, without any censoring. In 
practice, of course, there is always bound to be some censoring. 

To obtain this significant information it is necessary to create a 
“special atmosphere” which is characterized by a non-evaluative 


attitude on the part of the examiner—he is neither shocked nor ap- 
proving of anything he hears. 


He is an accepting person who tries 
to conv 


ey to the subject that he is earnestly interested in him as a 
person and respects him as an individual. This means that an effort 
is made by the examiner to avoid creating an atmosphere which may 
be characterized by the literal meaning of the word “test.” It is 
incumbent upon the examiner to establish a 


subject can talk freely and behave comfortably. It is not the pur- 
pose of the assessor to examine (and therefore the 


setting in which the 


word examiner is 
a poor one in this context) or to test in the evaluative sense, but 


rather to “get inside” the subject’s internal frame of reference. The 


psychologist gains such entry by communicating with his subject 
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through psychological instruments—Rorschach, Thematic Apper- 
ception Test, anamnestic interview, etc. In regarding the test situa- 
tion as a social situation much additional significant information 
can be obtained. How does the subject react to the examiner? How 
does he react to “testing”? How does he react to kindness or stress? 
Questions such as these, although they are “extra-test” data, are of 
significance for our purposes and require a sensitive observer to 
select and interpret them. 

The major instruments utilized in order to obtain insight into 
the subject's internal frame of reference will be described below, 
and the manner in which they fit into the rationale will be dis- 


cussed. 


ANAMNESTIC PROCEDURES 
These consisted of such devices as the interview and the bio- 
graphical questionnaire. Both involve a retrograde analysis of the 
previous background and history of the subject. First, data were 
requested with regard to factual information: Where was the sub- 
ject born? . . . What did his father do for a living? . . . What 


kind of an environment was he reared in? . . . How many siblings 
Secondly, the assessor was interested in the 


did he have? . . . etc. 
and reactions to the various facts thus 


subject's attitudes, feelings, 
obtained, e.g., How did he get along with his parents? es What 
were his relationships with his siblings? . . - How did he feel about 
attending school away from home? . . - ete.. : 
The third major type of information obtained from the subjects 
by means of anamnestic 
and interests—professional an 
garded as cathected activities, represer 
the subject from which certain inferences may be drawn, For ex- 
ample, information about a subject's hobbies and interests suggests 
inferences regarding the subject's energy level (was the subject 
active or passive), his needs for social contact (were his interests 


social or solitary), etc. 
Fourth, the subject was asked to describ 


procedures was in the area of their hobbies 
d extracurricular. These can be re- 
nting investments of energy by 


e himself, his present role, 
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and his future professional role. The subject’s evaluation of him- 
self might well reveal information not uncovered by other tech- 
niques. A comparison of this evaluation with the assessor's analysis 
and interpretation of behavior on other psychological techniques 
might also indicate the subject's insight and understanding of his 
own behavior, as well as the areas about which he may be particu- 
larly sensitive or which might cause stress and anxiety in the future 
if they were stimulated directly or indirectly. 

The subject's discussion of his present roles and future profes- 
sional role were also utilized as a basis for inferring a subject's 
needs and attitudes. For example, the female student-teacher who 
has told us about how her mother rejected her and then later dis- 
cusses how much satisfaction she gets out of taking care of small 
children suggests in effect that she might in her professional role be 
making up for lacks in her own earlier existence. But there was 
another value in obtaining information concerning the subject's 
perception of his own professional role, for this permitted the as- 
sessors to check the congruence or lack of congruence between the 


student's perception of his future role and that developed by his 
faculty. 


DIAGNOSTIC TESTS 

Two major sources of error in attempting to obtain data con- 
cerning the subject's internal frame of reference by means of inter- 
view and questionnaire techniques alone are (a) the individual may 
either consciously distort data, or (b) he may be unaware of all or 
the majority of factors which play a part in determining his reac- 
tion. In an effort to circumvent these obstacles it is necessary tO 
utilize techniques which elicit responses from the subject which 


he cannot evaluate himself. Under these conditions he is not apt to 


know whether he is successful in presenting the best picture of 


himself. Furthermore, these techniques should not necessarily be 
dependent on the subject's awareness or lack of awareness of the 
mainspring of his behavior. The most common psychological tech- 
niques that meet these criteria are the projective tests. 


The Analytic Approach 


Our conception of projective tests is that they are unstructured 
stimuli which, when structured or given form by an individual (in 
terms of percepts, stories, sentences, drawings, etc.), reflect the sub- 
ject’s approach to problem-solving situations, the quality of his 
affects, his needs, aspirations, and other factors that may be included 
under the rubric of “personality.” 

It should be pointed out, however, that the projective techniques 
utilized in the researches described here were not simply additive. 
It was assumed that each instrument would reveal different aspects 
of the personality under study. It might be said that the Rorschach 
revealed significant data concerning the “structure” of the individ- 
ual’s personality while the Thematic Apperception Test (TAT) 
provided significant data concerning the “content” of personality. 
To be sure, both factors can often be inferred from either test; we 
are speaking here in relative terms. For example, a Rorschach 
record regarded as constricted because of a very high F+% might 
be interpreted in conjunction with an intense need aggression re- 


vealed by the TAT. Of course, one might have inferred the need 
but utilizing it in conjunction with 


aggression from the Rorschach, 
heck on such tentative in- 


the TAT often makes it possible to cross-C 
e use of such complementary tests makes 


actions between test and subject. It 
absence of further evidence, that a 
more of himself on a TAT than on 


ferences. Furthermore, th 
allowances for possible inter: 
might be conjectured, in the 
“verbal” individual will reveal 
the Rorschach, while a “visual” 


The following projective tests W 
and Sentence Completion. Each of them 


type may do just the reverse. 
ere utilized: Rorschach, The- 


matic Apperception Test, 
will be described briefly below. 


t consists of a series of ten inkblots: 


Rorschach. The Rorschach tes 
-red, and three multicolored. In the 


five achromatic, two black-and 


present research the test was usually a 
administration was also undertaken. 


ct was asked to tell what he saw in 


dministered in individual 


Sessions, although one group 
In either circumstance the subje 
the blots and then to indicate the characteristics in the cards which 


65 


Methods in Personality Assessment 
were responsible for his perceptions. The responses of the subjects 
were then “scored,” by means of a system of shorthand notation 
developed by Klopfer (34), for four major factors: locations deter- 
minant, content, and degree of originality or “popularity” of a 
response. Location refers to that part of the inkblot selected by the 
subject for his response. Determinant refers to the stimulus char- 
acteristics of the blot-form—shading, color, or movement—that the 
subject selected for his response. Content refers to what the subject 
saw: animal, object, human, etc. The degree of originality or “pop: 
ularity” of a response refers to the frequency with which a given 
response is obtained in the population at large. 

Analysis of the Rorschach protocol yields significant informa- 
tion regarding the structural aspects of personality. Since so much 
has been written on the Rorschach and how it may be interpreted, 
the reader who is unacquainted with the test is referred to Sarason 
(54), Phillips and Smith (47), and Klopfer and Kelly (34). 


The Thematic Apperception Test. The Thematic Apperception 
Test (TAT) was originally developed by Morgan and Murray (44). 
With the exception of a single group administration for which only 


twelve cards were used, all twenty of the cards of the test—those 


for either males or females, and those for both sexes—were ad- 
ministered to our subjects in two individual sessions. 


The theoretical assumption underlying the TAT may be briefly 
stated as follows: subjects, w 


hen talking about others in unstruc- 
tured pictorial situations 


, are likely to be talking about themselves. 
Thus, the subject may identify with the indiv 


or they may discuss situations that 
Analysis of the themes of the stories 
needs, attitudes, aspirations and 


iduals in the pictures 
are of significance to them. 
usually reflects the subject's 


attitudes toward self and others. 
Such data are conceived as reflecting the “content” 


of personality, 
but the TAT also reveals data of 


“structural” significance. The 
structural material in the TAT may be gleaned from a study of the 


subject’s approach to the cards, an analysis of his thought processes 
as he develops a story, and the quality and extent of his perceptual 
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distortions. In general, the approach used in analyzing the TAT 
was that suggested by Stein (59). 


The Sentence Completion Test. The form of the Sentence Com- 
pletion Test used here was based on the one developed for the 
OSS assessment program and adapted by Stein (58). The test con- 
sists of 100 incompleted sentences that the subject is to complete as 
rapidly as possible with the first thought that comes to his mind. 
The sentences were constructed and selected in the hope that they 
would reveal data of significance in the following nine areas: Fam- 
ily, Past, Drives, Inner States, Cathexes, Energy, Time Perspective, 
and Reactions to Others. These areas are not exhaustive, however, 
since the completions themselves frequently yield information not 
subsumed under these headings. The analysis of the test is based 
on the interpretations of the completions. 

In addition to the Rorschach, TAT, and the Sentence Comple- 
tion Test, three other tests were developed in connection with the 
research program undertaken here. Since these tests were not 
utilized in the two examples of the analytic approach which follow, 
a description of them will be deferred to Chapter 7 when the spe- 
cial considerations which led to their development are presented. 


The Assessment Conference 


THE ASSESSMENT STAFF 


After the data described in the two previous sections have been 
obtained, they are collated and brought together for the assessment 
conference during which the assessors study the degree to which 
the criterion model and the personality picture of the individual 
are congruent. Judgments as to degree of congruence serve as the 
basis for predictions regarding the probable effectiveness of the 
assessed individual in the area for which the assessment has been 
undertaken. A description of the conference will follow, but first 
let us consider the composition of the assessment staff which has 
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been in existence from the beginning of the analytic assessment 
study. 

An analytic approach might involve a variety of individuals 
representing the various behavioral sciences. The OSS Assessment 
program (45), for example, included anthropologists, psychologists, 
and psychiatrists at various stages of its existence. In our own work 
the assessment team covered three major areas. These areas, and the 
function of the persons in each of them, are indicated below. 


l. Social Psychologist—background in psychology, sociology, 


anthropology, or human development, equipping the worker for 
the investigation of socio-cultural factors in performance situations. 
He has the responsibility of elaborating on the role of such factors 
in the situation being assessed, and also contributes towards the 
understanding of similar factors in the backgrounds of individuals 
which are functionally related to their current performance. 

2. Clinical Psychologist—background in personality theory and 
psychodiagnostic testing. The clinical member of the assessment 
team is primarily responsible for the analysis of the subject's in- 
ternal frame of reference, based upon considerations of needs, 
motives, and other factors in the inter- and intra-personal economy 
of the individual, past and present, which influence relevant per- 
formance. 

3. Educational Psychologist — background in measurement 
theory and test construction. Responsible for the development, 
analysis, and refinement of specialized instruments developed in 
the course of an assessment program for a specific setting. Con- 
tributes to an analysis of the learning environment and press. 


The various assessment teams which engaged in the particular 
projects described in later chapters of this work were so selected as 
to provide for the representation of these three areas on each team. 


In later studies, involving modifications of procedure discussed in 
Chapter 7, a fourth role was added. This was represented in the 


statistician, with a background in mathematical statistics and a 
broad knowledge of methodology in the social sciences. His con- 
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tribution lay in the development of efficient experimental designs 
and statistical analyses. 

Several representatives of each of these areas worked together in 
an attempt to arrive at an understanding of the internal frame of 
reference, a delineation of the press, a consideration of the inter- 
action between the two, and finally, the formulation of a predic- 
tion. Their separate capacities were utilized as fully as possible. The 
social psychologist, who is trained in clinical procedures and is 
sensitive to human behavior, may interview and test subjects; the 
clinical psychologist, who is aware of the press variables and has 
the capacity to talk to faculty and clicit critical data from them, may 
also be assigned to this task. 

Thus, in actual practice two or three of the functions referred to 
above were provided by the same individual, the four or five mem- 
bers of each team overlapping to a considerable extent in the skills 
siderable care was taken to ensure 


represented. In every case con 
members provided counter- 


that the graduate and professional 


checks upon one another, through this duplication of skills. Al- 
ghout the span of its own 


though each team remained intact throug 
project, thus providing for continuity and c 
he team tended to shift from one member to 
moved on from one phase to the next, with 
attern of skills required. 


ohesiveness, effective 


leadership within t 
another as the project 
resulting changes in emphasis on the p: 


CONCEPTUAL FRAMEWORK 


Because of the different training and experiences of the assess- 


ment staff members, differences in op 


differences may lead to serious schisms, dir 
ly. In the present research this did not prove 


thrashed out informally, 
bers of the various 


inion are to be expected. Such 
ninishing efficiency if not 


disrupting work entire 
to be the case. Existing differences were 
and the key to effective collaboration among mem 
assessment teams proved to be a healthy respect for one another 
coupled with a readiness to subordi 
goals. 


To insure further mutual underst: 


nate private interests to group 


anding, a common frame of 
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reference was considered essential. A list of needs and their defini- 
tions, based largely on Murray (44), was developed for this purpose. 
Although each assessor employed whatever scheme was most fa- 
miliar to him in his initial analyses, all group communications and 
discussions were couched in terms of this common conceptual 
framework. 


The framework consists of eight areas, as indicated below. This 
is not to be regarded as a definitive system, since further revision is 
even now in progress. However, this does represent the scheme em- 
ployed in all of the studies to be reported here, and subsequent 
modifications do not depart from it in any major way. 


A. INTERPERSONAL RELATIONS 


1, Reaction to Others—Direction of process of interaction with others. 
1.1 Affiliation (Af) 
Positive association with other persons, either peers or au- 
thority figures, valued as an activity involving friendly re- 
ciprocal interaction with others. 
1.2 Rejection (Rej) A 
Disassociation from other persons, either specifically or in 


general, limiting opportunities for interaction with others. 
1.3 Narcissism (Nar) 


Preoccupation with self. 


Coping Mechanisms—Characteristics of process of interaction with 
others. 


2.1 Succorance (Suc 
Helplessness; infantile dependence upon others for love, as- 


sistance, and protection. 
2.2 Nurturance (Nur) 
Supporting others b 
tion. 
2.3 Dominance (Dom) 
Achieving assertive, 
24 Deference (Dfr) 


y providing love, assistance, and protec- 


autocratic ascendancy over others. 


Sycophantic submission to the opinion or preference of an- 


other; emphasis on the glorification of another who is per- 
ceived as superior. 

2.5 Abasement (Aba) 
Self-depreciation; mortifying, mutilating, or otherwise de- 
valuing the self. 


70 


The Analytic Approach 


2.6 Aggression (Agg) 
Hostility towards others, overt or covert, in fact or in fantasy. 


2.7 Autonomy (Aut) 
Self-sustained; independent and unfettered. 


B. INNER STATE 


Impulse Acceptance—Acceptance of characteristic feelings and sen- 
sations. 
3.1 Sex (Sex) 
Erotic interest or expression. 
3.2 Sentience (Sen) 
Sensuous or voluptuous self-gratification. 
3.3 Exhibition (Exh) 
Self-display. 
3.4 Play (Ply) 
Valuing of amusement and entertainment. 


po 


4. Impulse Control—Inhibition, denial or sublimation of characteristic 


feelings and sensations. 

4.1 Blamavoidance (Bla) 
Control of impulses in or 

4.2 Superego Integration (SI) i 
Functionally autonomous 1 
thected. 

4.3 Superego Conflict (SC) 

3 Unsuccessful or incomp 1 

accompanied by feelings of anxiety an 


n of goal-directed activity. 


der to avoid criticism or disapproval. 


mpulse control, positively ca- 


lete internalization; impulse control 
d uncertainty. 


5. Energy Level—Intensity and directior 

5.1 Intensity (Int) . : 
Liberation of affective or effective tension. 

5.2 Endurance (End) 

Sustained effort. 

5.3 Achievement (Ach) 5 
The drive for success, accomplish: 
mounting obstacles—physical, pers 
in order to achieve success. 

5.4 Ego Ideal (EJ) 

Fantasied achievement. 


ment and recognition; sur- 
onal, and interpersonal— 


c. GOAL ORIENTATION 
e—Differentiation between self 


6. Autonomous-Homonomous Balance L 
cathective and perceptual 


and non-self; subjective and objective; 


Processes. 
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6.1 Exocathection-Extraception (ExX) i 
The manipulation of external objects through practical, 
concrete, physical or social action; adaptation to reality “as 
given” for more or less immediately tangible ends. 

6.2 Exocathection-Intraception (ExI) 

Dramatic, idealistic social action; active modification of real- 
ity to conform to private value-system; expression of ideals in 
concrete action. 

6.3 Endocathection-Extraception (EnX) ; 
The manipulation of external objects through speculative 
abstract thought or discussion; reflection and discussion 
about events or systems; data collection and inductive reason- 
ing. . 

6.31 Cathexis of physical objects and systems, e.g. physics, 
chemistry, etc. , ; 

6.52 Cathexis of social objects and systems, e.g. history, poli- 
tics, etc. 

6.4 Endocathection-Intraception (En]) . - 
Preoccupation with private experience; psychological, spir- 
itual, esthetic, or metaphysical truth; introspection and de- 
ductive reasoning. 

6.5 Understanding (Und) 


Disinterested intellectualization; analysis, abstraction, syn- 

thesis for the sake of conceptualization rather than action. 
6.6 Projectivity-Objectivity (PrO) 

Egocentric perce 


ption: animism, anthropomorphism, mystic- 
ism, superstition 


+ Self-Maintenance—Incor poration of past frustration and failures; 
ame pi 
patterns for buttressing level of self-esteem. 


7.1 Harmavoidance (Har) 


Avoidance, withdrawal, or protection from situations which 
might result in physical pain, injury, illness, or death. 
7.2 Infavoidance (Inf) 
Avoidance, withdrawal, or protection from situations which 


might result in frustration, failure, humiliation,or embarrass- 
ment. P 


7.3 Defendance (Dfd) 


Concealment or justification of failure or humiliation. 
7.4 Counteraction (Ctr) 


Restriving in order to overcom 


: € experienced frustration, 
failure, or humiliation, 


. Organization and Inte 


Sration—Characteristics of synthesizing ac- 
tivity. 
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8.1 Order (Ord) 
Organization of immediate environment; preoccupation 
with cleanliness, neatness, orderliness, arrangement, collect- 
ing, detailed precision. 

8.2 Conjunctivity (Cnj) 
Purposeful co-ordination, organization, and integration of 
specific activities as well as broader goals. 

8.3 Disjunctivity (Dsj) 
Confused, unco-ordinated, disorganized, diffuse or conflicted 
activity. 

8.4 Sameness (Sam) 
Fixated, repetitive, perseverative behavior. 

8.5 Change (Cha) 
Plastic, unroutinized, labile, changeable behavior. 

8.6 Impulsion (Imp) x 
Impulsive, spontaneous, unreflected behavior. 

8.7 Deliberation (Del) 
Hesitant, cautious, deliberative behavior. 

8.8 Emotionality (Emo) ' : 
Mobile, active, expressive, intense emotional responsiveness. 


8.9 Placidity (Plc) > i 
Passive, phlegmatic, restrained emotional responsiveness. 


THE CONFERENCE 
The process by which predictions were made is analogous to that 


developed at the Harvard Psychological Clinic (44), and may be 


termed a diagnostic council approach. In this situation, members of 


the assessment team responsible for analysis of the press present 
their data. These data reflect explicit and implicit characteristics 


of the press in terms of the assessor’s evaluation of their significance. 


From this discussion, inferences are made as to the characteristics of 


the kind of subject who would probably get along best in an en- 
vironment containing the press described. In arriving at this model 


of a hypothetical individual, the assessor utilizes the conceptual 


framework previously described as a language or schema for under- 


Standing and integrating need constructs. ; 

Having arrived at a formulation of the hypothetical personality 

model derived from an analysis of the press, the assessment staff can 

now proceed to the consideration of materials obtained from each 

of the subjects whose performance in this press is to be predicted. 
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Analysis of these psychodiagnostic protocols is restricted to the for- 
mulation of a picture describing the subject along the same dimen- 
sions represented in the hypothetical model. In order to facilitate 
further comparisons of these two configurations, the same concep- 
tual framework employed in describing the model deduced from 
the role analysis is also used in describing the individuals who are 
being assessed. 

It should be noted that no independent criteria concerning an 
optimal personality configuration can be tolerated at this point, nor 
can the projections of the assessor concerning generalized ideal types 
be permitted. The prior formulation of an explicit model is a par- 
tial safeguard against the introduction of irrelevant considerations 
at this point. In addition, the assessor must be discouraged from at- 
tempts at exhaustive clinical description of each case. The sole task 
in the assessment is to obtain a global picture of each case sufficient 
to decide whether the individual can be considered an exemplifica- 
tion of the hypothetical model or a departure from it. The function 
of the common conceptual framework, as has been indicated, is to 
provide a unified and stable frame of reference by means of which 
communication between assessors can be facilitated, thus permit- 
ting the drawing of sharp contrasts between the model and the sub- 
sequent analysis of individual subjects. 

By stating both criterion and individual diagnosis in the same 
set of terms, it was possible to reduce tendencies of the assessor to 
attend to aspects of the test protocol which were of possible signifi- 
cance in other contexts (i.e., clinical pathology, or therapy) but ir- 
relevant for the present assessment. The persistent sharpening of 
the diagnostic picture by this device was eminently effective in 
eliminating lengthy discussions of interesting but tangential mi- 
nutiae. This came to serve as a criterion for the admission of evi- 
dence during the assessment conference: was this datum of signifi- 
cance for prognosis in this situation, as opposed to considering all 
data which the protocols might be forced to yield. 

It is an almost impossible task to state the principles by which the 
staff actually sets about predicting how the subject will perceive and 
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react to the press. The content of the material obviously varies from 
one case to another. In general, however, the staff looks for situa- 
tional press in the subject’s past behavior which are similar in a 
Psychological sense to those to which he is being exposed at the 
present time. Having found these experiences, and having de- 
termined the subject's reactions to them, the question is whether 
anything new had happened to the subject which might alter his be- 
havior. If so, these are evaluated in an effort to determine if these 
reactions were momentary or well integrated into the personality. 
With this information the staff makes a prediction, or probability 
statement as it were, on the basis of the obtained data. Where it is 
Not possible to find experiences in the subject’s past which are simi- 
lar to the press to which he is presently exposed, the staff must ex- 
trapolate in terms of its general knowledge of personality dynamics 
and behavior, and once again predictions are made. 

The analytic approach, as described here, provides the closest ap- 
proximation toward estimating the characteristics of a transaction 
system involving a given person in a specified situation. As will be 
seen in the two demonstrations of this approach described in Chap- 
ters 4 and 5 which follow, predictions by assessors were found to be 
in accord with independent judgments by the faculty membe of 
the subjects’ actual performance. In Chapter 6 an attempt to subject 
aspects of the assessment process itself to empirical study will be 
presented. Further discussion of the merits and limitations of this 
approach will be deferred until after the presentation of these three 
studies. In Chapter 7 we shall resume the discussion of methodologi- 
cal considerations and undertake the development of three alterna- 


tive approaches. 
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CHAPTER 4 


An Analytic Study of 
Theological Students 


THE FIRST OPPORTUNITY TO TEST THE ADEQUACY OF 


the for x 3 
le formulations thus far adv 
Wester ; . . 
a theological seminary ofa liberal Protest 
i: favs z à 4 
e faculty of this seminary were concerned with the 


stu i : . : . 
ident selection. They had been screening candidates on the basis 
ation in extra-curricu- 


anced was presented by the mid- 
ant denomination. 
problem of 


Of previone a 
Previous scholastic performance, particip 
n former teachers, minis- 


lar activites 
activities, and recommendations fror 
arently sufficient to 


n Although this information was app: i 
belare Felgetian of applicants who were capable of meeting the 
Ena a tevenn of the MUNO: 3 evidenced by the ex- 
ra ow SGEEBENE of academic failure, 1ts adeguacy was never- 

fone questioned by the seminary staft, Not until several months 
after admission did the staff feel they knew the student well enough 


actually to judge his qualifications for the ministry. 
Moaea as the seminary contributed to the financial support of 
nee its students, this problem was particularly acute. Once 

, a student would be granted subsidy for a year. Students 
Committee for 


presented to the 


* Thi 
kis study was previously reported in a paper 
mber 21, 1953, and subsequently 


the Scient; 
Bahaa Study of Religion, Boston, Mass., Nove 
ished in (65). 
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who were found to exhibit characteristics which the staff felt inap- 
propriate for the ministry were not only carried for the balance of 
the year, but frequently there was difficulty in adjusting the situa- 
tion even then, since the academic performance of these students 
was often quite satisfactory. 

This situation seemed ideally suited for a miniature assessment 
program in accordance with the principles advanced in the preced- 
ing chapter. The problem, as conceived by the seminary faculty, lay 
in determining as early as possible whether a student would make 
a successful minister. The assessment team assumed that this posed 
two separate issues: (a) What factors make for successful perform- 
ance as a seminary student, and (b) what factors make for successful 
performance as a minister of this denomination? These two sets of 
factors need not be identical. Insofar as the faculty judged poten- 
tiality for the ministry in terms of student performance, the assess- 
ment team undertook the formulation of the student role which 
served as the basis for the faculty’s judgments. The assessment staff 
in this experiment consisted of a social psychologist, a clinical 
psychologist, and three graduate students in clinical psychology 


who were to aid in administering, scoring, and interpreting the 
test results. 


Developing a Criterion 


In accord with the first step in the assessment program, a series 
of discussions was scheduled in which the seminary faculty under- 
took to outline the historical, sociological, and psychological back- 
ground of their denomination. This provided the assessment team 
with a setting in terms of which the school could be understood, as 
well as an opportunity to hypothesize, formulate, test and reformu- 
late notions concerning the faculty and what they may constitute 
asa pres for their students. One outcome of these introductory dis- 
cussions consisted of a series of statements drawn up by the semi- 
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nary staff listing the major characteristics which they considered 
significant for the ministerial student. These were as follows: 


1. Is the individual capable of leadership when he has the ability 
to achieve it? 

2. In another situation, is he capable of following when the other 
fellow has the ability to lead? 

3. Can he distinguish between these two situations and act ac- 
cordingly? 

4. Has he the ability “to get along with” people who are different 
from him: older, younger; more conservative, more radical; men, 
women? Can he act skillfully with people of authority and with 
people of none? 

5. Can he keep sight of his goals and continue to pursue them 
while maintaining good relationships with others? 

6. Can he develop plans of study for himself which are reason- 
able and which he carries out independently? 

7. Has hea sense of humor? 

8. Is he emotionally attached or repelled by people in a way 
which is not a deviation from the usual? 

9. In the give and take of discussion does he play a part or parts 
which mark him as too aggressive, too submissive, or normal? 

10. Is he an orthodox, closed-system personality, masquerading 
ause he has liberal ideas, or is he really a liberal 
able of examining an idea or system, including the 


as a liberal bec 
personality, cap 
anti-liberal ones, with equanimity? 

11. Is he religious? Or, is he looking for religious answers and 
means to cultivate religious attitudes? 

12. Has the man creative ability of the several kinds required 
for the minister, sermon writer, administrator, educator, etc? 

13. Can the man stand up under community ridicule and fight 
back skillfully or retreat skillfully without fear? 

14. Can the man live without people attacking him? 

15. Does he have a trend, a direction of growth in his character? 


And if so, which way? 
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Although these statements have been formulated as questions, 
each contains an implicit definition of an attribute considered de- 
sirable for the ministerial students. The list may be considered as 
a set of expectancies which characterized the student role insofar 
as the faculty were concerned. In this list of expectancies there is at 
least one statement referring to cognitive behavior (#12), and at 
least one that is not at all clear in its present form (#11). It should 
be noted, however, that although relatively few of these are entirely 
unambiguous, the psychological sophistication of this faculty had 
resulted in statements of their objectives in terms that required 
relatively little translation into the psychological jargon with which 
the assessment staff was conversant and which it would have to util- 
ize in working with its test materials. 

In fact, these fifteen points proved a reasonable synopsis of the 
content of the discussions in which the faculty and assessors had 
been engaged. The assessors concluded that there was no evidence 
which controverted the picture of the desired person implied in 
these remarks. A restatement was formulated by the assessment 
team, representing the functional student model to be utilized as a 
criterion in the assessment of candidates. 


1. Interpersonal Relations. Includes capacity for involvement with 
others, the ability to interact skillfully with peers, superiors and sub- 
ordinates, without arousing hostility or rejection. Such rapport will 
involve social sensitivity, tact, and confidence in social contact. Ag- 
gressive impulses should be well socialized, and the individual should 
appear as autonomous rather than dependent or dominant. 
Inner State. Characterized by high energy, consistently and put 
posively directed. 

. Goal Orientation. Will be persistent in attacking problems, although 
not inflexible. When confronted with possible failure, the individual 
will counteract, restriving in order to overcome obstacles, rather than 
withdrawing or otherwise avoiding the issue. Although primarily 
intraceptive, the student will focus on people and personal relations. 
The structure under consideration here, referred to previously in the 
conceptual framework (Ch. 3) as Exocathection-Intrace ption, in- 
volves dramatic, idealistic social action, active modification of reality 
to conform to a private value-system, and the expression of ideals in 


concrete action. The content of this structure should be socio-politt 
cal as well as ethical-religious. 
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These appeared to be the major parameters of a hypothetical 
personality most likely to be identified with and accepted by the 
seminary faculty and judged by them as representing the superior 
student whose potentiality for the ministry is high. 


The Assessment 


SUBJECTS 

tative. Further testing and re- 
ployed as an actual criterion 
lidate and extend the model 


_The model, at this point, is ten 
vision is required before it can be em 
for selection purposes. In order to va 
the faculty were asked to provide the names of six students cur- 
rently enrolled in the seminary, three of whom typified the “ideal” 
Student, and three who represented students considered undesira- 
able. Only the names of the six students were provided the assess- 

| ment team; the faculty evaluations were not revealed to the asses- 
Sors until after prediction had been made. It should also be noted 


that the faculty had not been informed at this time of the content 


Of the assessment model nor, indeed, of the very fact of its existence. 


IC TESTING 
stered a battery of tests 
hree hours each. The 


pSYCHODIAGNOST 


| . Each of the selected students was admini 
In two private sessions of approximately t 
battery consisted of the following instruments: Wechsler-Bellevue 
Test of Adult Intelligence, Rorschach Ink-Blot Test, Thematic 


Apperception Test, Sentence Completi and an Autobio- 


raphi ‘ 3 
8raphical Questionnaire. 


on Test, 


CONFERENCE 
At no point was there an attempt to make an exhaustive clinical 
analysis of the data obtained with the instruments listed above. The 


Sole task confronting the assessors was tO obtain a picture of each 
hether the individual could be reconciled 


ASSESSMENT 


ca = i 
se sufficient to decide w 


With the model or represented a departure from it. 


Methods in Personality Assessment 
The assessment conference is probably the most critical aspect of 
the analytic approach. Unfortunately the conference sessions head 
not transcribed; even if they were, it would probably be difficult 
to convey to the reader the atmosphere of the group and the spirit 
that pervaded it. The assessors had a good deal in common with 
each other—they all had the hypothetical model in mind as a en 
terion, the constructs derived from the framework for the descrip- 
tion of personality referred to previously, and the test data. Al- 
though there were differences amongst the assessors in terms of 
their clinical experience and prior work in personality theory and 
prediction, these differences did not appear to impede the function- 
ing of the group. One could never tell which assessor would come 
up with an integrated view of the subject from which a direct esti- 
mate of the subject’s suitability for the seminary situation could 
be made. , 
The discussions and deliberations taxed the knowledge and in- 
genuity of each assessor, as well as his patience and scientific rigor. 
Intuitive insights were accepted, but only insofar as they could be 
bolstered by arguments founded in theory or concrete data. In dis- 
cussing a case, for example, one person might point out that the 
subject looked quite energetic on the TAT because he used many 
active verb forms, but another would reply that all these occurred 
on a fantasy level. A third would come to the second person’s sup- 
port by citing evidence for passivity in the subject's sentence com- 
pletions, and maintain the theoretical point of view that the data 
on the Sentence Completion Test should be more congruent with 
manifest behavior than the data from other tests. And so the dis- 
cussion continued until there was general satisfaction among the 
assessment staff that the case was understood properly, and that the 


reasons for predicting how the subject had been regarded by the 
seminary faculty were also understood. 


RESULTS 


The results of this study could obviously be stated very simply, 
but prior to revealing them let us turn to some of the data that were 
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obtained. From these data it will be possible to infer something 
Abone the characteristics of the population with which we worked. 
This summary will also facilitate extrapolations from these data to 
other experimental situations. 
Responses of the entire student 
questionnaire tended to confirm the hypothetical model presented 


e as a. à a ° 
arlier: the minister's role as perceived by the students was quite 
ith that revealed by the faculty. 


udents’ questionnaires, the fol- 


body to an autobiographical 


congruent in its major aspects W 
Summarizing the data from the st 
nguishable: 

to concern himself with the 


l of its activities—political, 


lowing general attitudes were distir 

l. The minister has an obligation 
well-being of the total community, in al 
social, and moral. 


2. The primary function of the minister is 
al action and reform, 
es the persuasive presenta- 
ewhat nurturant or 


to provide leadership 


for the community, in soci and to act as a 


D) var i 4 
Prophet in these matters. This involv 
to others, a som 


ti te a z 
on of one’s inner world-view 
d a readiness to give fully of 


protective attitude towards others, an 
one’s self in interpersonal relationships. 

: 3. The critical skill for a minister, and the most attractive qual- 
ity in an individual, concerns interpersonal relations. There is a 


POsitive attachment to supportive but non-controlling individuals, 


an age fi ee a, 
d a negative reaction to aggressive individuals who are seen as 
s group believe 


arrogant and domineering. The members of thi 
themselves to be skilled in social interaction. They also indicate 


the need for further development primarily 


th ‘ ` A 
rough psychological training towards W 


along these lines, 
hich somewhat magical 


attributes appear to be assigned. : 
4. These students refer to the minister intellectually as logical, 
analytic and open-minded. They indicate 4 need to appear ac- 


Ceptant of differences in intellectual outlook and approach, and 


manifest considerable interest in social problems. 


These responses are to be understood as the reflection of a pre- 
ommon beta press regarding the 


domi ae 
Ominant group opinion, 4 ci 
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climate of the institution, and the cultural milieu ie which the 
institution exists. It is interesting to note that the minister's role, 
as described here, was reproduced in essentially the same way by 
all members of this institution, both students and faculty. Since all 
the students were not equally acceptable by the faculty as candi- 
dates for the ministry, this supported our belief that differential 
fulfillment of this role, rather than the mere perception of it, 15 
apparently the significant index of student achievement in this 
milieu. 

Data from the Wechsler-Bellevue were of little value in dis- 
criminating among the six selected subjects. 1.Q.’s on the total scale 
range from 128 to 143, the good and poor students being dispersed 
irregularly throughout these fifteen points. Performance on che 
sub-tests is generally uniform and without significant scatter, with 
the exception of one student from each group who gives indications 
of anxiety but without marked impairment of performance. 

It is customary to find about 75 per cent of the variance unac 
counted for when predicting performance from some measure of 
intelligence. For the group from which our sample was drawn it 18 
likely that an even larger percentage of residual variance Eet; 
perhaps due to the high cut-off point which has been employed m 
the original selection of these students. One might well question 
the necessity for maintaining such high standards in this situation. 
In any event, it seems likely that this error variance can be con- 
siderably reduced when factors concerning personality and role- 
fulfillment are taken into consideration. 

Data regarding the emotional stability of the six cases provided a 
clear indication of the impossibility of predicting faculty accept- 
ance or rejection on the basis of arbitrary clinical judgment. The 
test materials indicated some difficulty in overall adjustment for all 
six subjects; maladjustment as such did not seem to be a necessary 
hindrance to effective behavior in the seminary, a setting which 
provides considerable support for the student in terms of the ethos 


of their profession. In fact, four of the six subjects were either in oF 


84 


An Analytic Study of Teacher-Trainees 


arranging for 
ging for therapy, and four were experiencing difficulty achiev- 
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student this might well be merely the surface appearance of an es- 
sentially narcissistic individual. Energy level was high for these 
three students, and accompanied by high goals and counteractive 
restriving. Finally, all three individuals were predominantly in- 
traceptive, coupled with a cathexis of external factors that are 
chiefly social. Although introspection and inner soul-searching 
were not entirely lacking, energy was expended primarily on the 
active influencing of situations and people along lines dictated by a 
private system of values. 

It was further brought out in the assessment conferences that 
the other three subjects differed markedly from the model, and to 
some extent from one another. Social relations ranged from at- 
tempted dominance to strained uneasiness. All three lacked insight 
or sensitivity to others. Although energy level was high, much was 
lost by all three as a result of anxiety and tension. Only one of the 
three could be called counteractive; a second appeared to respond 
to frustration with extra-punitiveness, while the third was ap- 
parently more perseverative than persistent. An exocathective-in- 
traceptive structure (idealistic social action) somewhat similar to 
that specified in the model characterized one, although the em- 
phasis in this case was more upon compulsive introspection and 
metaphysical speculation than upon social action as indicated in 
the model. The other two could be more accurately described in 
terms of exocathection-extraception: the manipulation of external 
objects through concrete acts for more or less immediately tangible 
ends. Status, security, and community recognition seemed to con- 
stitute the major source of their motivations for the ministry. 

The assessors concluded that the first three described above were 
selected by the faculty as test subjects for their adequacy, whereas 
each of the other three represented a student who had been con- 
sidered unfavorably by the seminary staff. These conclusions 
peared to be identical with the faculty judgments. Although only 
six cases were employed in this study, the complete replication of 
the faculty's judgments by the assessors is Statistically significant, in 
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the sense that the probability of judging the six cases independently 
in an identical fashion by chance can be set at (3/6)(2/5)(1/4), or 
five in 100 trials. Further evidence of the validity of the assessment 
might be found in the faculty's ability to recognize with little dif- 
ficulty the individual students from unidentified case reports that 
were prepared on each of them. 

Two years after the study reported above was completed, more 
quantitative analysis of the student model was attempted by means 
of a Q-sort (cf. Ch. 6), consisting of statements of skills and abilities, 
personal characteristics, interpersonal relations, and beliefs and 
values which are potentially characteristic of successful ministers. 
Although some variation in emphasis is discernible among de- 
scriptive sorts by faculty, students, and ministers, the faculty expec- 
tations regarding students as revealed by the Q-sort remain essen- 
tially similar to the initial assessment model derived two years 
earlier (2). Some characteristics of a more parsimonious approach 
to the assessment of larger numbers of candidates in this setting 
will be referred to in Chapter 8. 

In view of the successful experience described above, subsequent 
research (2) at the seminary has been directed to the development 
of models of currently functioning professionals, i.e., effective mem- 
bers of the ministry of this denomination. A comparison of minis- 
ters and students will be used in order to establish the relevance of 
the educational experience now being offered by the seminary, as 
well as the ultimate validity of the student model and techniques 
utilized on the current student body for the selection of new stu- 
dents. 

Clinical studies of ministers and students now in progress, how- 
ever, reveal rather striking differences between the two groups. The 
Successful minister (selected by this same faculty) may, for example, 
lack the personal charm and tact considered so important in the 
Student. Such findings make it quite clear that the prediction of 
ultimate professional performance cannot, without further inquiry, 
be based on criteria related to success as a student. Furthermore, 
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it is also evident that scholastic and academic performance are not 
always related to factors which are important for success as a pro- 
fessional in this field. 


Summary 


A midwestern theological seminary provided an opportunity 
for testing the adequacy of the formulations presented in the pre- 
vious chapters. The seminary faculty's problem was to determine 
as early as possible whether a student would make a successful 
minister. The assessment staff narrowed this still further, restrict- 
ing itself to predicting the student’s success while in school without 
considering potential postgraduate professional success. 

Six students were selected by the faculty to serve as subjects in 
this experiment. The faculty’s evaluation of these students was 
not made known to the assessment staff until after the assessors had 
completed the assessment process and revealed their own decisions. 

The criterion for the assessment consisted of a hypothetical per- 
sonality model of the optimally functioning student. This model 
was based on an analysis of the situational demands implicit in the 
seminary at thal moment in time, as revealed through a series of 
“anamnestic” conferences between the seminary faculty and the 


assessment staff. The students were examined with a battery of 


psychological tests, the material evaluated in an assessment con- 
ference, and decisions as to which were “good” and “poor” students 
were arrived at by means of a comparison between the model and 
the actual clinical data for each subject. The decisions of the assess- 
ment staff were in agreement with the evaluations of the seminary 
faculty. 

The adaptation of the results of this study to practical assess- 
ment procedures for candidates to the seminary is still in process. 
Some of the current findings will be presented in Chapter 8. The 
larger problem, of identifying factors which make for successful 
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performance as a minister (rather than as a student) of this denomi- 
nation after graduation from the seminary, still remains. Impres- 
sions derived from pilot studies of ministers are different from those 
of students obtained in the academic situation and, therefore, dif- 


ferent models are required for such predictions. 
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CHAPTER 5 


An Analytic Study 
of Teacher-T rainees 


HAVING BEEN SUCCESSFUL IN OUR ASSESSMENT IN THE 
theological seminary, we attempted to replicate these results in an- 
other setting. Such a setting was available in a special elementary 
school teacher-training program where the desires of the faculty 
were essentially the same as those of the seminary staff—to maximize 
the number of successful students in their program by means of 


more adequate assessment procedures. 


Developing a Criterion 


Our approach here was essentially the same as that described in 
the preceding chapter. Several conferences between the faculty of 
the teacher-training program and the assessment staff were held. 
The seminary faculty, since they had been engrossed with the prob- 
lem for some time, could provide us with a list of the factors they 
sought in their students very shortly after we made this request. 
This was not the case, however, in the experiment to be described 
here. In the teacher-training program more effort was necessary to 
orient the conferences in such a way that the faculty could com- 
fortably reveal their activities, judgments, and opinions about a 
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variety of students. These revelations served as the raw material on 
which inferences were based. During all initial mectings, both to 
keep the atmosphere uncritical and to avoid premature conclusions, 
the assessors made no attempts to interpret any of the material to 
the faculty. All communication from assessors to faculty consisted 
in clarifying the need for information and knowledge about the 
faculty and students of this program. 

During these sessions the assessors listened to the faculty discuss 
the kinds of people they accepted for their program and those they 
rejected. Concrete illustrations of the manner in which the faculty 
conducted their selection interviews were provided. Positive and 
negative characteristics of applicants were discussed, ¢.g-, older ap 
plicants looking for an “educational nest egg” were apparently dis- 
couraged from entering the program. The faculty described pre- 
vious classes of students, indicating examples of successful and 
unsuccessful student performance. Discussion of the current das 
was avoided to prevent the assessors from becoming familiar with 
the cases on which they might later have to make predictions. , 

At times the faculty experienced difficulty, arising from differ- 
ences among themselves regarding some particular question. It was 
found that presumably self-evident educational objectives or goals 
could not be as clearly defined as might have been desired. This was 
particularly true in relating aims in training for teaching with aims 
in educational administration. Another element considered by the 
assessment team was the consistency with which the faculty main- 
tained their convictions in the selection and judgment of students. 
Through these discussions, the assessment team gained insight into 
the faculty’s values. The more information which could be gathered 
into the net, no matter how diffuse or tangential it might have ap- 
peared at the time, the more likely would be the success of the in- 
ferences on which the assessment model was to be fashioned. 

On the basis of applicant and student descriptions, as well as the 
explicit and implicit aims and values of the training program and 


faculty attitudes, the assessors derived the following hypothetical 
model: 
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l. Interpersonal relations. Students are expected to have a positive, 
friendly, co-operative, and giving attitude toward others—children, 
peers and those in authority, This attitude was not to be encum- 
bered by anxieties and tension, so that relations with others would 
be comfortable. Also precluded were excessive dependency and/or 
childish or ulterior motives in social relationships. Put in other 
terms, a high level of maturity, defined by the faculty in these terms, 
is strongly valued. Tendencies to withdrawal are discouraged. Some 
independence and autonomy is desirable. 

. Inner State. A high level of energy is another factor which is con- 
sidered very important. Flow of energy should be constant, directed 
to relevant matters and turned to the practical ends that are de- 
manded in teacher-training. 

. Goal orientation. The faculty wants assurance that students in teach- 
er-training have at least a partial professional orientation. Stu- 
dents who have shown their interest by avocational work with 
children before applying for teacher-training are preferred. The 
faculty is dubious about students who are looking for vocational 
“insurance,” or whose aims are ultimately in some other direction. 
This includes girls whose chief goal is raising a family. A certain 
amount of “calling,” of dedication to the job, is desired. In the 
students, this is reflected in the orientation and intensity of their 
goals. These are expected to be highly relevant to teaching, to have 
a “pure” motive, and to be strong enough not to be displaced easily 
by other goals. In the face of frustration, students are expected to 
recognize and accept the frustrating circumstance and their own feel- 
ings in regard to it, regardless of the discomfort that the frustration 
may arouse. Evasion, retreat, concealment, or rationalization, are all 
methods that are discouraged. Students are expected to face frustra- 
tion and actively strive to overcome it, without developing any de- 
vious defensive maneuvers to avoid doing so. 


N 


Qə 


Subjects 


A limitation of the seminary study lay in the restriction of the as- 
sessment to extreme cases as selected by the faculty. It is quite pos- 
sible that the assessors’ discriminations were facilitated to some de- 
gree by the elimination of representatives of the middle range, ra- 
ther than by the professed utilization of the hypothetical model. 
This second study was undertaken in order to investigate this pos- 
sibility. 
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The faculty of the special elementary school teacher-training pro- 

gram made available to the assessment staff its total student enroll- 

ment of ten persons for study. The faculty rank-ordered all ten 

students in terms of their relative success in the program. None of 

these data were available to the assessors until after they had con- 
cluded their own deliberations. 


Psychodiagnostic Testing 


The research staff then administered a series of tests to the ten 
students. Four of these tests were the same as those used in the 
seminary study. These were: Wechsler-Bellevue Test of Adult In- 
telligence, Rorschach Ink-Blot Test, Thematic Apperception Test, 
and the Sentence Completion Test. 


Assessment Conference 


The test results were presented at the assessment conference and 
decisions were arrived at after discussions similar to those described 
previously for the theology students (Ch. 4). In contrast to the 
seminary experiment, where the students were rated merely as 
“good” or “poor,” the teacher-trainees were ranked in terms of 
probable success in the program. The successful students were con- 
sidered to be much more like the model than the unsuccessful stu- 
dents. 

Examples of a successful and an unsuccessful case, as judged by 
the assessors, follow. Analyses of the test data are organized within 


the same dimensions as the hypothetical model, facilitating the 
comparison of each individual with the model. 


CASE B (SUCCESSFUL) 

1. Interpersonal relations. B makes efforts to be accepted in a group: 
She is friendly, and often reacts to rejection by fighting for accept- 
ance. Nevertheless, she also likes to be autonomous. For example, 
she expends a good deal of energy in the almost rebellious assertion 
of her intellectual independence. Her defiance, however, does not 
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. Inner State. B is a highly energetic person, capable o 
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seem to show itself in hostility toward other people in her work 
relationships. She is able to assume a position of authority, and has 
some desire to do so, although a tendency to become rigidly authori- 
tarian causes her anxiety. She is able to accept children’s needs to be 


independent. 
f mobilizing 

e and lasting effort. 

llectual interests with intense de- 

lities, perhaps to the ex- 


her resources effectively for intens 
Goal Orientation. B pursues inte 


termination. She has confidence in her abi 
tent of over-evaluating herself at times. Only the prospect of clear 


failure, stemming from external forces over which she has no control, 
tends to reduce her to passive resignation. On the other hand, when 
she does not feel that it is a matter of domination by another person 
and she can have a sense of independence in her activities, it is very 
likely that she will struggle energetically to overcome an obstacle. 
Furthermore, she will probably attempt various tactics until she is 
successfully counteractive. In this respect her generally practical and 


concrete approach to problems probably helps her. When she gets 
jeteriorates into concern with un- 


anxious, however, this approach ¢ 
essential matters. It is possible that she may become somewhat pe- 
dantic, 

CASE I (UNSUCCESSFUL) f i 
Interpersonal relations. Being unusually sensitive, I is alert to pos- 
sible slighting from others. This makes her feel extremely uneasy and 
self-conscious when with others, so much so that her tension is per- 
ceived by them, making them uncomfortable in her presence. 
Toward older men, her ambivalent feelings make her relationships 
even more difficult. Very much desiring a warm, fatherly friend, she 
is afraid of losing him. Consequently, she is at once the child who 


makes bids for sympathy and protection, the coquette, and the sus- 
ho must maintain distance. She has 


picious, mistrusting person W 1 ; Sy ccd RE 
given much thought to her own difficulties and can tree'y a 

matically verbalize them. But this is not to solve them. She does not 
regard herself as a self-sufficient, respected, mature adult. She feels 
inferior in many respects, including intellectual matters, jee oe the 
fact that on intelligence tests she is within the bright normal range. 
She can never attain the status of a leader within any group, since 
she is always ready to identify with those who resent and defy any 
form of authority. She can’t hope tO maintain order and discipline 
because of her position. She wants desperately to rely upon and trust 
Others, but she expects to be let down. Her main desire is to have 


ji ri 4 7 do 
people li s i for her, personally, because they 
e ge she employs a naive exhibitionism. 


like her, To accomplish this, 
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She tries to maintain interest in herself by spinning wonderful fan- 
tasies, a technique she finds successful only with young children. 

2. Inner State. I has a great deal of poorly channelized energy. She has 
several plans going simultaneously but does not follow through on 
any of them. 

8. Goal Orientation. When difficulties arise or unexpected situations 
occur, I retreats. She may capitalize on her weakness, poor health, or 
simply evade the problem. She has a magnificent imagination. She 
deliberately chooses her own fantasies—not as daydreams, but as 
things which she can communicate to others as imaginative products. 
Comparison of these cases with the model illustrates the differ- 

ence between judgments of successful and unsuccessful trainees in 


relation to the model. 

After the assessment staff had made its judgments, a conference 
was held with the faculty of the teacher-training program, during 
which comparisons were made of the judgments of both faculty and 
research staff. Prior to this point, the assessment staff had no knowl- 
edge of the faculty's ratings. During these conferences the staff also 
presented descriptions of each of the students to the faculty, obtain- 
ing the faculty’s evaluation of these reports based on their previous 
knowledge and experience with these students. 


Results 


The results of the comparison between faculty judgments and the 
assessors on all ten cases were as follows: 


Faculty Assessors 

A A 

Successful Students B B 
C H 

D D 

Intermediate Students E E 
F 

G G 

H c 

Unsuccessful Students 1 | 
U j 


I he rank-order correlation for these data is +.70, significant at 
the .02 level. 
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There was agreement on all students except two whose positions 
Were reversed by the faculty and research staff. This disagreement 
apparently arose less from lack of understanding of the personalities 
of the students than from insufficient clarity in the construction of 
the model. In the case of student H the assessment staff had con- 
sidered energy level and counteraction to be very high, as was the 
need for affiliation, but associated with underlying feelings of hos- 
tility. Such feelings were not expressed, however, but held in check 
by means of rigid conformity and a compulsive drive for achieve- 
ment, both associated with considerable anxiety. These defensive 
characteristics were taken by the assessment staff to have positive 
adaptive value in this situation, apart from their function within a 
Neurotic structure. The faculty did not disagree with this evalua- 
tion of H; on the contrary they indicated in the conferences that 
they had in effect already recognized the neurosis and rejected the 
Student. 

A reversal of this situation occurred in the case of student C. The 
assessors felt that a great deal of latent instability was indicated, 
making prognosis poor despite many superficial similarities with 
the criterion model. The faculty, it was learned subsequently, had 
chosen C as successful on admittedly slender evidence; C was a 
newcomer to the program who had been chosen because of her ex- 
Perience with children in a Sunday school class, and the apparent 
Strength of her goals in teaching. 

No disagreements occurred with the remaining cases. The inter- 
Mediate students, it will be recalled, had been included in the pres- 
ent study as a check on the adequacy of the assessment. It was felt 
that Predictions in the seminary for extreme cases had provided a 
less rigorous test than one based on the entire range. In the present 
Study, both faculty and assessors were found to agree upon a gradi- 
Ent among the intermediates, reflecting the extent to which they de- 
Parted from criterion performance. Those closer to the top were 
More similar to the model, but lacked dedication to teaching; those 
lower had difficulty in relating to children and showed some degree 
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of anxiety, but were not as extreme in deviating from the model as 
the three unsuccessful teachers. 

Two points arise from this material. One, that substantial agree- 
ment existed between the faculty and research staff—enough to 
demonstrate the success of communication between them. An as- 
sessment staff was able to utilize its techniques in assessing students 
on the basis of a frame of reference derived from the conceptions of 
the faculty, and formed into a hypothetical model. 

The second point, arising from the disagreements that occurred, 
involves the validity of the model as derived from faculty concept- 
tions. One may ask to what extent the judgment of the faculty 
represents idealized opinions and aims that are unconsciously re- 
linquished in actual practice. In selecting students, do the faculty 
actually employ the implicit verbalized criteria which the assess- 
ment team assembled into the hypothetical model? 

It would seem that in this case the assessors did not, or were un- 
able to, take into account the effects of longer or shorter periods of 
time in the relationship between a given student and the faculty. It 
might be argued that with the addition of such information, the 
two erroneously classified cases would have been judged correctly. 
Extensive experience with student H must surely result in insight 
into his neurotic structure; a brief acquaintance with student C 
might hardly reveal the nature of her disturbance. 

Although there is some power to this argument, the fact remains 
that the assessment team was still uncertain as to when, if ever, the 
faculty would gain such insight into student C. And no member of 
the assessment team was prepared to make out a case for the appat- 
ent insight of the faculty into student H, even with the knowledge 
available during the post-mortem. The discussions with the faculty 
were not sufficient, in themselves, to provide more than a pre 
liminary formulation of the hypothetical model. The validation of 


the model required precisely the type of test represented by these 
two studies: an empirical analysis of criterion cases. 


The initial formulation of the seminary model survived this test 
without difficulty. In the case of the teacher-trainees, however; it 
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was evident that something in the nature of a reformulation was 
necessary before this model could be considered adequate for actual 
screening purposes. The techniques employed in this reformulation 
constitute a supplement to the analytic approach which can also be 
employed as an alternative and independent approach. This aspect 
of the problem will be discussed further in Chapter 7, and will be 
followed by a presentation of the next phase of the teacher-training 


study in Chapter 8. 


Summary 


A teacher-training situation provided us with the second oppor- 
tunity to test the formulations of the analytic approach. The experi- 
ence in developing the theoretical model here differed from that 
encountered in the seminary. It underscored the need for a flexible 
approach on the part of the assessors as they deal with faculties in 
such matters. 


Ten students, the total populati 
as subjects for this experiment. They had been ranked in terms of 


Success by their faculty. The assessors, after they had gone through 
had also to differentiate among 


Its of this experiment in- 
greed significantly with 
ch the assessors had no 


on of trainees at the time, served 


the necessary assessment procedures, 
the subjects in terms of rankings. The resu 
dicated that the rankings of the assessors a 
those assigned by the faculty and about whi 
Prior information. 

Inspection of the two rankings indicated, h 
Sessors had made erroneous placements of two students. Since this 
Might be a reflection of the inadequacy of the model which might 


affect future predictions, it v 
Sults more precisely. The manner 
and the direction for clarification, 
and 8. The present stage of the experiment in 
Post-diction must be utilized for clarifying factors involved in the 
model, thereby increasing predictive efficiency. 


owever, that the as- 


yas necessary to re-evaluate the test re- 
in which this was undertaken, 
will be indicated in Chapters 7 
dicates how errors in 
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A Study of the Analytic Methodology’ 


THE EXPERIENCE GAINED IN THE TWO PROJECTS JUST 


described raised several questions about the analytic approach 


which seemed to warrant independent investigation. These ques- 
tons concerned (a) communication among members of the assess- 
ment team, and between the team and the resident faculty, (b) the 
process of interaction among these various people during the assess- 
f various techniques employed for 


ment, (c) the comparative value o 
ntent of both the faculty 


Psychodiagnostic purposes, and (d) the co 
and assessor perceptions of student performance. 

The exploration of these problems appears to involve techniques 
which permit the statistical manipulation of non-quantified obser- 


vati 3 is z 
ation. Q-sorting procedure offers a means for obtaining relation- 


ships among descriptive characterizations made by various people, 
and is therefore well-suited to our particular purposes. A discussion 
of the methodological and statistical implications of Q-technique is 
to be found elsewhere (41, 61); a simplified computational scheme 
has been presented in a note by Stern (67). In this chapter our sole 
concern is with the results of a Q-sort design which was employed 
in a modified assessment situation in order to obtain information 
regarding the four points raised above. 

* Portions of this study have been presented in two earlier papers (37, 80). 


101 


Methods in Personality Assessment 


Experimental Design 


A group of teachers and assessors evaluated the behavior of a 
sample of students over a period of time. Analysis was made of the 
extent and direction of shifts in these evaluations, obtained in terms 
of Q-sorts, as further increments of information about the students 
were introduced. The individuals involved consisted of (a) four 
members of an elementary school teaching staff, (b) five psycholo- 
gists at various stages of training and experience, and (c) six 7th 
grade students selected at random. Group (a) will be referred to as 
teachers, Group (b) as assessors, and Group (c) as subjects. 

The personality framework described in Chapter 3 was employed 
as a guide in constructing a set of 50 statements applicable to 7th 
grade pupils. In addition to sampling various aspects of the frame- 
work, the statements were also devised to range in reference from 
explicit observable behavior to inferential diagnostic comment. 
Overt behavioral statements were adapted where possible from ac- 
tual statements made by teachers about students as found in the 
records of this school. Individual teachers and assessors indicated 
their evaluation of each of the six subjects by means of Q-sort de- 
scriptions after study of or participation in each of the following: 
school records, projective data, situational observations, case con- 
ference, and a post-conference follow-up. In addition, assessors 
sorted for “self,” “good student,” and “poor student” at the begin- 
ning and end of the project, and the six subjects sorted for “self” on 
two different occasions. 

School records provided information on 1.Q., social history data 
from the parent, and school progress reports. The richness of these 
data depended to some extent on the amount of time the child had 
attended the school. Personality descriptions contributed by teach- 
ers to these records, as a matter of school routine, were sometimes 
helpful; frequently, however, these tended to follow a stereotyped 
pattern. 


Projective testing was carried out by four of the psychologists, 
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utilizing the Rorschach, TAT, Figure Drawings, and an autobio- 
graphical essay. In order to prevent the students who had been se- 
lected as subjects from becoming aware of their role in the study, 
the entire class section of fourteen students was tested. The Ror- 
schach and TAT’s were obtained in individual sessions. The draw- 
ings and autobiographies were obtained as a part of seemingly rou- 
tine classroom procedure, the drawings being assigned in an Art 
section and the autobiographies in English. 

Situational observations were also made a part of the classroom 
work in a Dramatics section. The observations were scheduled in 
two sessions. In the first, the class as a whole was given a task to per- 
form which had been presented to them in very general terms: they 
were instructed to come to the next class meeting prepared to dis- 
cuss and cast a play they wished the class to perform. At class time 
the fourteen students were invited to structure the discussion with- 
out further direction from the teacher. The pupils spontaneously 
elected a chairman who presided over the discussion of the various 
plays proposed and the consequent selection of a suitable play for 
the class to present. In the same session the students proceeded to 
settle upon a pattern of try-outs for the casting of the play and to 
the assignment of roles among themselves. In this small group there 
was no difficulty in observing the six particular students who were 
the subjects for this study—the roles they chose, their success or 
failure in these roles, their various attitudes toward the group, etc. 

The second session of observations was more controlled. Situa- 
tions were chosen pertinent to the age group and involving two 
Pupils in each case. All pupils in the class were observed in these 
Toles, although systematic variation of the kinds of roles assigned 
Was carried out only in the six cases singled out for observation. 
These improvisations involved the spontaneous acting out of a stu- 
dent or teacher role in the case of a failing student, a cheating stu- 
dent, and an indifferent student, the procedure being similar to 
that employed by the OSS staff (45). 


Following the role-playing observa 
Scheduled for each of the six cases- These conferences provided an 


tions, a case conference was 
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opportunity for sharing information obtained initially by indi- 
vidual assessors. The results of the projective testing, for example, 
had been known previously only to those clinicians who had ad- 
ministered these tests, and each of them had been restricted to one 
technique. The exchange of ideas about data provided by the 
school records and observations also took place for the first time in 
the case conferences. Approximately an hour and a half were spent 
in conference on each student. 

The conferences represented the fourth occasion on which de- 
scriptions of the six subjects by teachers or assessors had been ob- 
tained. These descriptions, in terms of the Q-sort, were provided 
after examination of (1) the school records, (2) projective testing 
(four assessors only), (3) role-playing observations, and (4) the con- 
ference. Seven to eight weeks after the conference sorts were com- 
pleted, a final sort was done by each teacher and assessor for each 
case. During this two-month interval there was no communication 
or interaction between the clinicians and teachers. 


Preparation and Treatment of Data 


The design indicated above, a portion of which has been repro- 
duced in Figure 1, provided a total of 306 separate Q:sorts, from 
which a matrix of over 90,000 coefficients could be obtained. Only a 
limited number of these coefficients are important for our present 
purposes, however. The correlations in which we are interested con- 
sist of the following: 


1. Auto-correlations (Correlations between subjects sorted by the same 
sorter) 

(a) Within sorts (the diagonal cells of the complete matrix): correla- 
tions between descriptions of subjects provided by the same 
sorter in any one of the five phases of the study. 

(b) Between sorts: correlations between descriptions of subjects pro- 
vided by the sorter for different phases of the study. 

2. Cross-correlations (Correlations between sorters on the same subject) 

(a) Within sorts: correlations between sorters during the same phase 
of the study. 
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(b) Between sorts: correlations between sorters in different phases 
of the study. 
These four classes of coefficients are indicated somewhat more 


clearly in Figure 1. It will be noted that all sorts by a given teacher 
orrelated, regardless of the phase in 


descriptions of different subjects by 


or assessor have been interc 
which they were obtained. The 
different sorters were not compared, however, but only those sorts 
subject. Although the number of 


between sorters based on the same 
this means from 93,330 


coefficients to be computed was reduced by 
to 13,209, the task was still of sufficient magnitude to require the 


facilities of International Business Machines. 
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9 the four classes of coefficients computed- 


6-fold matrix Q-sorts, indicat- 


each subject by ar- 


The sorters had been instructed to describe 
ng of 2, 5, 8, 10, 10, 


qT i a $ a: 
anging the 50 statements in eight piles (consisti 
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8, 5, and 2 statements respectively), which ranged from “most char- 
acteristic” to “least characteristic” propositions about the subject. 
Since the distribution was fixed, the arrays for all Q-sorts have the 
same mean and sigma: N = 50, M = 4.5, and c = 1.705. A product- 
moment coefficient may be computed directly from the value of 
EXY in this case, since r = (ZXY — 1012.5)/152.5. 

The required [XY’s were obtained in four steps. 1. Each sort was 
transferred from the sorter’s tally sheet to an IBM card. 2. All cards 
for the same subject were gathered together and run through an ac- 
counting machine. The pile to which each statement had been as- 
signed by the various sorters in describing that subject was added 
into a selected counter. 3. At the end of the group of cards for each 
subject, a summary card was cut. This card indicated the piles to 
which a specific statement had been assigned by each sorter in de- 
scribing the same subject. 4. The deck of summary cards for each 
subject, one card per statement, was then run through the account- 
ing machine yielding the required cross-products by progressive 
totalling and further summary punching. 

From this last set of summary cards, a card was prepared for each 
correlation to be found, indicating the ZXY obtained for a pat 
ticular sort-subject-sorter pairing. These cards were collated with a 
punched table of r, and the coefficients then gangpunched. Since the 
reported data were to be based chiefly on averaged correlations, the 
z transformation (21) was punched along with the r. Matrices of 2's 
were listed, summed, averaged, and then transformed back to TS: 


Results 


The data obtained from this design will be considered in terms 
of the information yielded with regard to four general problems. 
The first of these is concerned with the comparative performance of 
the two groups of participants in the assessment: faculty and asses- 
sors. We should like to know whether these two groups differ ini- 
tially in their orientation towards subjects, the characteristics of 


106 


=. 


A Study of the Analytic Methodology 


these differing viewpoints, and the extent and direction of changes 
which might occur during the process of the assessment. These 
questions will be explored by means of an analysis of the Q-sort 
descriptions of the subjects provided by the teachers and the as- 
sessors after each exposure to an additional increment of informa- 
tion. 

i Closely related to this problem of group performance are the in- 
dividual interaction effects among specific members of the two 
Sroups of participants. 

And finally, insofar as a uniform orientation is worked out among 
the various assessors, we should like to know how accurate a picture 
of each subject is reflected in this orientation. Validity in the pre- 
ceding two studies was established by means of a comparison be- 
tween the assessors’ appraisal of the subjects and an appraisal by the 
resident faculty. In the present case it will be possible to employ a 
More direct test, afforded by a comparison of interrelationships 
among assessors’ descriptions of the subjects with the corresponding 
interrelationships among actual self-descriptions by the six sub- 
Jects. This analysis will also yield some information regarding the 
contributions of various sources of data to the assessment process. 


GROUP DIFFERENCES 
assessors’ 


Aspects of changes which took place in teachers’ and 
sured by 


© ee 
Valuations of students as the study proceeded were mea 


four ind; z E 
ur indices: confounding, identification, projection, and consen- 


Sus, 
tiate among students 


ts being described in 
magnitude of the 


` Confounding refers to a failure to differen 
™ Psychological terms, each of the six subjec 
essentially the same fashion. It is measured by the 
intercorrelation between sorts for all subjects by the same sorter. As 
Figure 9 indicates, the teachers tended to be characterized initially 
by Stereotyped notions of the students. The average of the intercor- 
+s descriptions of the six subjects is 
05 level, following both the 
he observations of the sub- 
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ae tions among each teacher 
s ae fer 
a € to statistical significance at the . 
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mination of the school records and t 
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jects in situational testing. This intercorrelation drops towards zero 
following the conferences, however, and remains at the same point 
or slightly lower in the terminal sort two months later. 

Intercorrelations among the assessors’ sorts, on the other hand, 
are close to zero for all four phases of the study, indicating that the 
assessors tended to perceive each subject as a relatively unique en- 
tity. This ability to discriminate among the six pupils in terms of 
the Q-sort was not acquired by the teachers (or communicated to 
them?) until the time of the conference. Once achieved, however, 
the tendency to discriminate persisted among the teachers for at 
least another seven or eight weeks without further contact with the 
clinicians. 
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Closely related to the preceding two measures is the estimate of 
projection, measured by the relationship between sorts for indi- 
vidual students and the sorter’s description of an “ideal” student. 
Figure 4 indicates this relationship to have been significant at the 
.05 level for the teachers at the time the school records were ex- 
amined. This figure is very much like that describing the data on 
identification (Fig. 3), in that both teachers and clinicians are mov- 
ing towards a negative relationship between “ideal” and actuality 
by the time of the terminal sort. And again the clinicians show a 
tendency to deviate from an apparently more objective appraisal on 
the occasion of the situational testing only. 

The teachers, then, were somewhat autistic in their initial per- 
ceptions of the subjects. As the study proceeded, however, they 
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Projection: the average intercorrelation between descriptions of each of the 
six subjects and the individual teacher or clinician descriptions of an “ideal” 
student. 
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tended to approximate the performance of the clinicians, maintain- 
ing this new orientation for at least two months beyond their last 
contact with the clinicians. With the exception of the observations, 
the psychologists remained essentially at the same level throughout 
the study in confounding, identifying, or projecting in their student 
descriptions. If it can be assumed that objectivity is inversely re- 
lated to these three indices, then the change in behavior shown by 
the clinicians at the time of the situational testing suggests a pos- 
sible weakness of techniques involving observations of performance 
in routine group activities. Perhaps under these conditions normal 
subjects function in sufficiently standardized ways as to mislead the 
psychologist, trained to perceive anomalous or pathological distinc- 
tions, toward seeing only an undifferentiable normalcy—resulting 
in confounding, identification, and projection. On the other hand, 
these three measures are not likely to constitute a perfect criterion 
of objectivity, since the subjects may in fact be similar in some de- 
gree to one another or to the sorter. We shall see subsequently the 
extent to which this is indeed the case. 

Consensus, the fourth measure, is reflected in the correlations be- 
tween sorters describing the same subject. Teachers and clinicians 
achieved significant agreement in their descriptions of individual 
pupils by the end of the study, as shown in Figure 5. Although the 
peak of agreement obtained immediately after the conference is not 
far beyond the .01 level, it should be noted that points in these 
figures represent the average of 24 to 30 correlations each. The 
minimum and maximum correlations obtained by individual pairs 
of judges on a single case at each point in the study are shown in 
Table 1. Here it will be observed that individual correlations in ex- 
cess of -+.60, far beyond the .001 level of significance, were being 
ery beginning of the study. On the other hand, 


obtained from the v `; 
nt between pairs of assessors as the study pro- 


the rise in disagreeme 
ceeded is evidence against agreement having been obtained between 


clinicians and teachers purely through the operation of such factors 
as prestige or status. It might be noted in passing that by the end of 
the study the cases had stabilized to the point where the same stu- 
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Consensus: the average intercorrelation among descriptions of each of the six 
subjects by all teachers or clinicians. 


dent is contributing to each minimum correlation between pairs 
of teachers, clinicians, or teacher vs. clinician, and a second student 
is involved in each of the three maximum correlations. 

Figure 5 and Table | both suggest a drop in consistency among 
the clinicians for sorts based on the projective tests alone. The lack 
of agreement among the four assessors who administered and in- 
terpreted these tests is a reflection of several possible factors, includ- 
ing the lack of comparability among the four techniques employed 
(Rorschach, TAT, Drawings, and Autobiographical Essay), the dif- 
ferences in experience and training between the four testers, as 
well as possible deficiencies in any one or all of the projective tests. 
Unfortunately, this study cannot indicate to what the observed ef- 
fect should be attributed, although it is apparent that the problem 
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Table 1. Minimum and Maximum Intercorrelations Obtained on Individual 
Students by Pairs of Teachers or Clinicians, Compared with the Aver- 
age Group Intercorrelation 


Gi 
Sort Sorters Minimum Pair Maximum Pair Average No. of Pairs 
Teachers —.22 Co aa -25 24 
Records Clinicians —.19 P-e iaia 27* 30 
Teach. vs. Clin. —.27* eZ ORR* 24 120 
Projectives Clinicians —.34* gpx 12 24 
Teachers —.24 aran -18 24 
Observations Clinicians —.20 F- saaa -24 30 
Teach. vs. Clin. —.27* a -24 120 
Teachers —.09 163*** sa7ae 24 
Conference Clinicians —.48*** F nana "i ab 30 
Teach. vs. Clin. —.26 Farse A0** 120 
Teachers —.41** PY dala <29* 24 
Post-Conference Clinicians —.28* Bates .36** 30 
Teach. vs. Clin. —.43** .68*** .36** 120 


* Significant at the .05 level 
** Significant at the .01 level 
*** Significant at the .001 level 


could be effectively explored in the future with only minor modi- 


fications in the present design. 


INDIVIDUAL INTERACTION EFFECTS 


In addition to these overall group effects, patterns of significant 
correlations within and between sorters as the study proceeded pro- 
vided indices for rating individual assessors on the stability, origin- 
ality, and adequacy of their percepts. It also proved possible to 
evaluate the effects of participation in group activities on and by 
the various teachers and psychologists. Differential performance 
among the assessors were identified by means of patterns of inter- 
vhich apparently reflect differing degrees of clinical in- 
sight, resistance to change, and orientation to the group task. To 
illustrate the type of inferences drawn from the correlational data, 
and the correspondence with actual behavior, a few examples will 


correlations v 


be given. 
Teacher B evidenced an extremely low level of consistency with 
herself, no significant correlation with her own earlier sorts appear- 
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ing until after the conference. Her position in the group is periph- 
eral, movement toward the group center being limited to a moder- 
ate degree of agreement with others at the case conference. Most 
other sorters at this time were very highly intercorrelated. Nor do 
the pre-conference sorts by this teacher correlate significantly with 
later sorts by others, demonstrating that her original percepts were 
not accepted by the group. Her initial sorts for “self” and for the 
“ideal” student both correlated negatively with the sorts on all six 
students; her description of the “poor” student was positively cor- 
related with her descriptions of the actual subjects. The direction 
of this agreement was changed by the post-conference sort, indicat- 
ing that she was now evaluating the students more positively than 
before, but the shift is not a very great one. 

The pattern of these correlations indicated a person who was 
viewing the subjects in terms of her own needs, failing to appreciate 
the individuality of the child, and rejecting him for reasons un- 
ascertainable from these data. It is impossible to accept her evalua- 
tion of the students as all “poor,” especially in the light of the eight 
other sorters—both clinicians and teachers—who failed to reach a 
similar conclusion. Participation in the study represented an ex- 
perience in which there was a different focus for evaluating the be- 
havior of students. Her attempt to achieve this new orientation is 
successful, to the extent that there is a lowered tendency toward 
projection, identification, or confounding on her part by the end of 
the study, and a somewhat greater tendency to evaluate the student 
ina fashion similar to the other assessors. Her failure to achieve con- 
sistency with herself or agreement with the other sorters in describ- 
ing these students by the termination of the study suggests the ex- 
perience to have been neither sufficiently intensive nor lasting 
enough to have effected much change in her mode of behavior. 

The impressions of the clinical members of the assessment team 
concerning the role played by Teacher B tend to corroborate this 
picture. She was one of the younger members of the school staff. Her 
behavior was noticeably different from the remainder of the group. 
Her contributions to the case conferences were meager, consisting 
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of anecdotes about student behavior the point of which was neither 
clear to the other participants nor of apparent relevance to the dis- 
cussion. Such comments, accompanied by attempts at non-project- 
oriented social interaction, seemed intended to provide a social ra- 
ther than work basis for relating herself to the group in some role 
which she could play with relative ease and security. In contrast, 
the other teachers, although also in a strange situation, seemed 
anxious to explore new ways of perceiving the students, entered 
readily into work-oriented interaction, and freely discussed and 
argued interpretations of student behavior offered by other asses- 
sors during the conferences. These differences are reflected in the 
correlational patterns for the others. 

Teacher D affords an interesting contrast. Although moderately 
consistent with herself prior to the case conference, and highly con- 
sistent from conference to terminal sort, there is no continuity 
bridging the pre- and post-conference aspects of the study. Her im- 
onference were stable, but were apparently 


pressions prior to the c 
a new and equally stable orientation. 


dropped at the conference for 
od a marked swing toward the clinical position, 


This shift involve 
wch higher correlations with the clinical 


ented by mt 
eachers by the end of the study. The behavior 
indicated seems that of a follower of the clinical group who could 
rapidly and effectively adopt their point of view when exposed to it 
"This was done readily, to the point of abandon- 
viously held with con- 


and was repr 
group than with the ¢ 


at the conference. 
ing prior orientations which she had pre 
sistency. 

This description also fits the impressions of the clinical psycholo- 
gists. Although a member of the teacher group, D was more highly 


trained in psychological and educational theory than her associates. 


Having identifications in both groups, 
found the orientation of the clinical group congenial as she gained 
further experience with their modes of thought. Although the study 
an autocratic fashion, it was apparent that the 
newer frame of reference would come from the clinical group which 
d assumed the major responsibility for the project. 


it is not surprising that she 


was not conducted in 


had planned an 
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VALIDATION 

The data thus far suggest that successive increments of informa- 
tion about a subject are utilized by assessors in the development of 
an increasingly stable and “objective” diagnostic picture. Consider- 
able consensus is achieved between assessors participating in such a 
task, and this agreement is apparently communicated and shared 
with less psychologically trained personnel. A particularly striking 
feature of these data is the tendency for this diagnostic formulation 
to persist as long as it did among the teachers. Two months after 
the cessation of their contact with the psychologists, during which 
time they were meeting with these subjects on a daily basis in the 
classroom, the teachers were still utilizing a diagnostic picture of 
each student which was essentially like that arrived at at the assess- 
ment conferences. 

This in itself would appear to indicate some degree of validity to 
the assessment; an inadequate diagnosis would have been revealed 
during the two months of further interaction between teachers and 
pupils, resulting in the abandonment or serious modification of the 
position the teachers had adopted at the conferences. A more direct 
test is available, however, which not only provides a validity check 
but also yields information regarding the relative contribution of 
each phase of data-gathering to the final diagnostic picture. 

Each of the six students had been required, along with the rest 
of their classmates, to sort the Q-items employed in this study in a 
self-description. The student self-sorts were then intercorrelated, 
yielding the matrix shown in the upper portion of Table 2. It will 
be noted that three of the students cluster together, their self-de- 
scriptions correlating highly with one another, and not with the 
remaining three students. Two of the remaining students consti- 
tute a cluster, and the last one has no significant correlations with 
any of the other five. Thus, similarities in self-percept as reflected by 
the Q-sort reveal a triad, a pair, and a singleton among the six sub- 
jects. 

If it can be assumed that similarity in self-concept is paralleled 


116 


A Study of the Analytic Methodology 


by similarity in underlying dynamics, then a test of the adequacy 
of the assessors’ descriptions of these subjects would lie in the extent 
to which similar clusters are revealed in their own diagnostic sorts. 
That this is indeed the case is shown in the lower section of Table 
2. The assessors’ terminal sorts two months after the conferences 
have been intercorrelated here, yielding the same triad, pair, and 
singleton as had been obtained from the subjects’ own self-sorts. 
However, the assessors have exaggerated this relationship to some 
degree; in addition to reproducing the clusters, they have also 
caused them to appear somewhat inversely related to one another 
(as revealed by the significant negative correlations between clus- 


ters) rather than simply orthogonal. 


Table 2. Relationships Between Subjects’ Self-Descriptions and Sorters’ Ap- 


praisals 
SORTERS SUBJECT 
Kr3 Li4 Kol Ko2 Nob los 
1 Kr3 
Intercorrelations he 
Between ie 
Subjects’ Actual Red 
Self-Sorts 
Le5 


2. 
Intercorrelations 
Between 
Sorters’ Terminal 
Descriptions of 
Each Subject 


3. 
Subject 24 26 
vs. Sorters 


24 .37** 22 12 


* Significant at the .05 level 
** Significant at the .01 level 
*** Significant at the .001 level 


The assessors themselves were not aware of the extent to which 


these clusters had been incorporated in their sorts. The transcripts 


of the conference proceedings indicate that references had been 


made only to the similarity between subjects Ke2 and Ne6; appar- 
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ently no one had been consciously aware of the implicit relation- 
ship between the other subjects which had nevertheless been ex- 
pressed in the diagnostic sorts. 

The last line of Table 2 gives the correlations between assessors’ 
diagnostic sorts and the subjects’ self-sort. As might be expected, 
these are relatively low. In only one of the six cases is there a signifi- 
cant relationship between diagnosis and self-percept. This potential 
index of insight in the case of subject Ke2 is further supplemented 
by the fact that this was the only subject of the six with whom the 
assessors identified and projected by the end of the study. In marked 
contrast to the trend for the rest of the group, shown previously in 
Figures 3 and 4, both assessor self-sort and assessor description of 
the “ideal” student correlate at the .001 level with assessor diag- 
nostic descriptions of this subject. 


TEST EVALUATION 

The parallel between clusters described by the assessors and those 
actually existing among the self-sorts of the subjects has been shown 
in Table 2 at the time of the terminal Q-sorts. If we trace these 
clusters back through earlier phases of the study, to their first ap- 
pearance, we have a measure of the relative contribution of each 
source of information to the development of the final diagnostic 
picture. Cases Ke2 and Ne6 first appear as a pair at the time of the 
projective testing. Despite the fact that the descriptions of the sub- 
jects obtained from the various psychologists at that time were not 
in marked agreement, as noted in Figure 5, each psychologist indi- 
vidually tended to describe these two cases in a similar fashion. 
Thus, the Jack of agreement between diagnoses obtained from dif- 
ferent instruments by different testers is not, in itself, an adequate 
demonstration of the lack of validity for such devices. They appar- 
ently contributed valid information regarding this particular pair 
of subjects, although the limitations of the present design prevent 
us from determining whether there was a difference in the relative 
contribution of particular techniques or particular testers. 

The triad between cases Kr3, Li4, and Kel does not appear in 
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diagnostic Q-sorts by the psychologists until the time of the situa- 
tional observations. It would appear as if the situational observa- 
tions facilitated the recognition of similarities which had not been 
previously apparent. This accounts for the sudden decline in the 
indices of “objectivity” at this time, since these indices assumed 
that there were in fact no interrelationships in the characteristics of 
subjects and assessors. 

The teachers do not begin to identify the pair and triad until the 
conferences, at which time these clusters become increasingly sharp- 
ened and polarized. The negative correlations between them, shown 
in Table 2 for the terminal sort, are even more pronounced at the 
time of the conferences. This suggests an apparent exaggeration of 
the differences between these clusters which has only been partially 
reduced during the two-month period which intervened between 
the conferences and the terminal sort. Perhaps the exaggerated 
polarization facilitates the identification of the individual subjects 
and accounts for the stability of the assessors’ percepts, in a fashion 
somewhat similar to that of a social stereotype. 


Conclusions 


The present study has indicated that: (a) assessors and teachers 


differ in their initial approach to the psychological assessment of 


student subjects, the teachers being less capable of discriminating 


between the various subjects and more prone to see students as like 
themselves as well as like their stereotype of the ideal student; (b) 
with added increments of information on each subject the psy- 
chologists tend to develop an increasingly stable and valid diag- 
nostic picture; (c) projective tests and situational observations both 
contribute useful diagnostic information, the observations yielding 
data not provided by the projectives; (d) maximum consensus in the 


diagnosis of each case is achieved in a diagnostic council or confer- 
y all persons having access to the case; (e) this 


ence participated in b eu 
ly among both teachers and clini- 


diagnosis can be shared effective: 
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cians, and tends to persist as a stable formulation for the teachers 
even after contact with the clinicians has been disrupted. 

These results tend to confirm our previous impressions regard- 
ing the dynamics of the analytic assessment situation as reported in 
the two preceding chapters. In addition, some practical results of 
the present study were to be found in the heightened interest of the 
teachers regarding the individual student, and the numerous sug- 
gestions from the psychologists concerning the treatment of specific 
problems encountered in the classroom. The teachers appeared to 
gain satisfaction from obtaining more integrated pictures of indi- 
vidual students, enabling them to understand facets of behavior 
which had hitherto been obscure. The clinicians learned to inte- 
grate findings from psychological procedures with school problems, 
making for more pertinent contributions as the study progressed, 

These observations tended to suggest a number of other potential 
applications of the technique employed in this study. Among the 
many possible methodological applications which seem indicated, 
the following appear most relevant. 

The dynamics of small group processes may be studied by assem- 
bling a population of statements describing such variables as group 
atmosphere, degree of satisfaction with the group interaction, and 
the aims of the group. The correlation matrices should provide in- 


sights into the progress made toward attaining such aims, and might 
offer a means of identifying group members in terms of their contri- 


bution to successful group functioning. 

Diagnostic instruments might be evaluated in terms of the degree 
of success with which the diagnostician approximates a criterion 
sort in describing test subjects. This type of usage also opens up aà 
mode of evaluating trainees or job applicants. From a series of 
sample protocols, Q-sort descriptions might be established for each 
case as criteria. Evaluation of the ability of the trainee or applicant 
can be made from the extent to which he gleans from the protocols a 
picture of the subject as already presented by the criterion sort. 

An assessment reported or discussed in analytic or diagnostic 
terms is often difficult to evaluate or to contrast with the results ob- 
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tained from other assessments of the same subject. A means of 
quantifying and evaluating the assessment of a subject from several 
points of view seems available here. From a trait sample a model of 
a functioning personality appropriate to a given situation can be 
set up. Individual assessors, perhaps looking at different types of 
available material, record their impressions of the subject in terms 
of the Q-sample. The degree to which these impressions are con- 
gruent with the dynamics laid down in the criterion model is given 
quantification through the correlation coefficient, and can be taken 
as indicative of the suitability of the candidate. In addition, agree- 
ment between assessor sorts would indicate that sufficient data had 
been available; disagreement between assessors would point up 
the need for further study of the individual, of particular sources of 
data employed, or of the adequacy of individual assessors. 

This procedure can also be employed as a training device for as- 


sessors, teachers, or clinical trainees, familiarizing them with the 


use of a psychological frame of reference in describing test subjects. 

In employing Q-sorting procedures for studies along these lines, 
several limitations encountered in the present project are worth 
keeping in mind. 

1. Exponents of Q-sorting technique fre 
of statements employed for granted, assumi 
constitute a representative sample of some universe of personality 
discourse. It is essential, however, that the items not only be drawn 
from as wide a range of personality factors as possible, but that the 
usual approach to test items involving analysis of difficulty, am- 
+ to ensure meaningful results. 
iting the statements in ac- 


quently take the sample 
ng implicitly that these 


biguity, etc., be utilized in orde 
2. Care should be exercised in distribu 

assigned frequencies. Failure to do this on the 

may seriously affect the computed coellicients, 

djusting the formula. 

aluating the behavior of each sub- 


cordance with the 
part of the sorters 
unless taken into account by a 


3. A standard context for ev 
ject should be made explicit. Where items refer to concrete be- 


haviors which may be affected by situational contexts, variations in 
description will occur which may be equally valid but will reduce 
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the magnitude of the correlation coefficient. This can occur, for ex- 
ample, when two assessors both consider the same subject in terms 
of an item dealing with overt aggressive behavior, but one estimates 
this behavior for the subject at home and the other estimates it at 
school. 

4. An arbitrary decision might be made in advance concerning 
representation of major trends for a given subject. Where several 
factors characterize an individual, each represented by several 
items, the mechanics of Q-sorting as currently employed result in 
some distortion. Since the number of statements to be sorted out 
to the extremes is fixed in number, two alternatives are available 
to the assessor: (a) bring all relevant statements as close as possible 
to the extreme by restricting the representation of each significant 
factor to one or two items—the remaining items, although equiva- 
lent in the assessor's mind, of necessity fall toward the middle of the 
distribution, or (b) emphasize one factor by bringing all the items 
relevant to it out to the extreme—other factors, although equiva- 
lent in importance, fall toward the middle of the distribution. Al- 
though the problems raised by the indiscriminate use of these two 
alternatives can be reduced considerably if the Q-sample is in- 
creased to a fairly large size, smal] samples might still be useful if 
uniformity in sorting procedure were to be established in advance. 
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Alternative Approaches 


IT WOULD APPEAR, FROM THE EVIDENCE OFFERED IN 
the preceding chapter, that personality configurations formulated 
by trained assessors on the basis of evidence derived from various 
psychodiagnostic sources can be both reliable and valid. Two ap- 
plications of an analytic approach utilizing such configurations for 
predictive purposes were described in Chapters 4 and 5, one in a 
theological seminary and the other in a teacher-training program. 
Both of these studies demonstrated the usefulness of personality 
models derived from analyses of functional roles. Attempts to pre- 
dict faculty judgments of performance on the basis of congruence 
between the psychodynamics of individual students and the cri- 
terion model in the analytic assessment approach were highly suc- 
cessful, Such models would seem appropriate as criteria for identify- 
ing applicants most likely to be viewed with satisfaction by the 


faculty. 
However, the small n 
projects, and the high cost of 


umber of cases represented in these two 
analysis per case in terms of time as 


well as money, make the limitations of this approach clear. The 

essential characteristics of the testing techniques employed in these 

two studies constitute a major cost factor. The Rorschach, for ex- 

ample, requires an hour to administer and several additional hours 

to interpret. Relatively few subjects can be tested within the period 
123 


Methods in Personality Assessment 


of time which can be allocated for practical assessment purposes. 
Furthermore, depth interviewing and projective techniques place 
an excessive premium upon the assessor. He can handle only a 
limited number of cases, and attempts to increase capacity by ex- 
tending the size of the assessment staff are likely to be defeated by 
the problems which interaction within large teams would create. 

Perhaps even more significant is the peculiar importance to be 
attached to the assessor's skill in establishing and maintaining an 
adequate relationship with the subject. If the assessor is successful 
he will have elicited data of considerable value. An unskillful as- 
sessor, however, may fail to obtain relevant information, unknow- 
ingly cause the subject to bias or distort his responses in the test 
situation, or even so alienate the subject that his co-operation is 
lost entirely. It is apparent that the assessor in the interviewing 
and projective testing situation is himself a part of the measuring 
instrument. This is one of the factors that complicates the develop- 
ment of a scientific methodology in this area. 

A further practical problem lies in the relative scarcity of per- 
sonnel who are capable of conducting an analytic assessment. The 
number of persons who have had sufficient training and experience 
with clinical procedures, who are capable of sustaining adequate 
testing relationships, and who are not likely to distort the data 
they interpret in terms of their own personalities, is quite limited. 
It would seem highly advantageous, then, if techniques could be 
developed which do not rely too heavily on the examiner—tech- 
niques which would yield the kinds of data ordinarily made avail- 
able in the person-to-person situation, but which are not as heavily 
dependent upon the arts of the particular assessor. 

The development of “non-clinical” instruments for the purpose 
of measuring congruence between individual subjects and the 
criterion model would seem to offer a number of important ad- 
vantages. Paper-and-pencil tests, tailored to the unique require- 
ments of the model and the situation for which it proved appropri- 
ate, require no special training for their administration. Any 
individual with a minimal degree of poise and social presence may 
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Alternative Approaches 
administer such tests to large groups of individuals. The testing of 
subjects in considerable numbers can thus be facilitated, the test 
situation becomes more formalized and less subject to the idiosyn- 
cracies of the personal interchange between assessor and candidate, 
and the role of the assessor is reduced to that of interpreting results 
and making recommendations. In fact, some techniques (cf. the 
synthetic approach below) do not even depend upon the assessor 
for final interpretation, thus avoiding still another source of vari- 


ability and possible error. 


The Empirical Approach 


The development of such tests has long been a matter of concern 
to a great many psychologists. The usual research design employed 
for this purpose has involved the attempt to discover some test or 
measure which will reproduce an already established empirical dif- 
ferentiation of subjects. Thus, the first step in the empirical ap- 
proach is the selection of a standard of performance which is con- 
sidered to discriminate between adequate and inadequate per- 
formers, In practice, the standard of performance is some construct 
symbolizing success, skill, or competence which must then be 
quantified so as to constitute a criterion. The quantification may 
be achieved by means of ratings provided by “significant others’ — 
teachers, supervisors, commanding officers, etc.—who are ordinarily 
the ones to decide which of their subordinates are in fact successful. 
In order to secure greater reliability, however, more impersonal 
and objective measures are frequently sought, such as grades, work 
output, sales volume, and the like. In either case, the criterion is 
then applied as an index of discrimination between successful and 
unsuccessful performers on the job. The resulting groups of sub- 
jects, who are thus presumed to differ on the abstract standard of 
performance initially posited just as well as they differ on the cri- 
terion itself, are then employed as criterion groups in an attempt 
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true of conventional measures alone. This recommendation is based 
on the assumption, elaborated earlier in Chapters 1-3, that the ca- 
pacity for sustaining specific forms of interpersonal transactions is 
critically involved in most criteria encountered in ordinary prac- 
tice. 

In the analytic approach such models were obtained essentially 
through a functional analysis of the situational press. Now, how- 
ever, we shall have to depend exclusively upon diagnostic testing 
to provide us with relevant parameters for the model, analysis of the 
press being confined solely to the selection of relevant criteria for 
the initial differentiation of groups of subjects. In order to simplify 
the procedures involved in determining the dimensions of such 
models for larger groups than those employed in the earlier analytic 
studies, several modifications were attempted in the studies exem- 
plifying the empirical approach which are reported in Chapters 8 
and 9. The first of these is closely related to the projective tech- 
niques previously employed, differing only in its applicability for 
group administration. Spontaneous drawings of human figures 
were included in the diagnostic test battery, following Machover 
(38), but making use of a technique adapted from Travers (76). The 
subjects were required to draw pictures of a relevant work situation, 
such as “a picture of a teacher at work in the classroom," or “a 
physicist at work in his laboratory.” These were used as projective 
devices in order to gain insight into the individual's perception of 
himself and his professional role. The deliberately unstructured 
nature of the task requires the subject to select spontaneously those 
aspects of the professional role in question which are most signifi- 
cant to him, thus revealing characteristics of the role performance 
which are related to his own internal needs. 

An even simpler test, from the point of view of administration 
and scoring, was developed subsequently for the purpose of ob- 
taining a much broader range of data regarding the subject's in- 
ternal frame of reference. This instrument, the Activities Index, 
is a considerably modified version of a test originally developed by 
Sheviakov for the Progressive Education Association (57). Unlike 
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its predecessor, and other instruments of a similar format such as the 
Strong Vocational Interest Blank or the Kuder Preference Record, 
the Activities Index was developed as an objective representation of 
variables stemming from an explicit psychodynamic approach to 
personality. Eight psychologists independently coded over a thou- 
sand items describing commonplace daily activities in terms of the 
conceptual framework for the description of personality referred to 
previously in Chapter 3. 

An inventory was assembled from 300 of the items unanimously 
considered to be diagnostic of specific elements in this personality 
taxonomy. Subjects respond to these items by indicating their like, 
dislike, or indifference for each activity. The test is based on the 
assumption that potential participation, or the manifestation of 
interest, in a specific class of behaviors is a reflection of the subject's 
personal needs. Although responses to the test are machine scored, 
the relationship between the various sub-keys requires integration 
and interpretation by the assessor in order for it to yield a diagnostic 
picture of the individual subject or selected aggregate of subjects. 

The use of the Activities Index permits something of a reduction 
in the costs of developing the hypothetical personality model. The 
extensive interviews between faculty and assessor have been elim- 
inated, and the role of the assessor has been reduced to interpreting 
the results of the testing in order to construct an empirical model 
which differentiates the criterion groups of subjects. But the as- 
sessor’s role must be limited still further, in the actual screening 
process itself, if the selection of personnel is to prove economically 
practical. 

One approach to this is illustrated by means of sub-scales drawn 
from the Activities Index which provide indices that are specific to 
a given personality type, without requiring that the content of the 
personality structure in question be identified. Or we can search 
still further afield for potential correlates of the underlying pattern. 
In fact, insofar as the empirical approach emphasizes peripheral be- 
haviors which are presumably symptomatic of a central personality 
structure, no attempt need be made to actually elaborate upon the 
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central structure itself. It is sufficient to draw upon empirically 
differentiated groups for the purpose of discovering further em- 
pirical differences in peripheral processes only. The particular be- 
haviors to be predicted are simply related to other peripheral 
behaviors which may be more conveniently measured without plac- 
ing the subject in the actual criterion situation. 

These procedures will be illustrated in Chapter 9. In addition to 
a successful screening scale derived from the Activities Index, sev- 
eral other indices were either adopted or devised which seemed 
potentially relevant on the basis of a priori judgment. These tests 
were also objective in their format and scoring, each yielding a 
single quantifiable measure which could be directly correlated with 
the criterion. Notable among the instruments in this group was a 
measure of response to Physiognomic Cues constructed by Stein, 
Stern and Lane, and a series of cognitive tests developed by Thur- 
stone as measures of three primary factors: speed of closure, flex- 
ibility of closure, and space (70, 72). A study by Pemberton (46) 
had suggested a number of specific relationships to be found be- 
tween these factors and certain personality characteristics important 
to our own investigations. Unfortunately, none of these perceptual- 
cognitive tests proved particularly useful. In the present studies the 
rigorous requirements fulfilled by our subjects at the time they 
entered the university tended to restrict variations in intelligence 
to a considerable degree. As a result, our main efforts were directed 
towards the assessment of personality factors, which in turn proved 
to be our most useful measures. 

Although both the analytic and empirical approaches make use 
of personality models in resolving the criterion problem, the em- 
pirical approach tends to be somewhat more practicable to the ex- 
tent that it succeeds in reducing the role of the assessor appreciably. 
The assessment team is employed primarily at the outset of the 
empirical study, making inferences as to which factors will correlate 
well with the criterion, and then developing or selecting tests which 
will reflect these factors. After the actual relationships between test 
scores and criterion have been determined, the assessment team con- 
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structs the hypothetical model and considers the development of 
additional tests in order to increase the precision of the assessment. 
Although this approach is well suited to the treatment of large 
groups of subjects, its disadvantage lies in the very empiricism on 
which it is based. The test batteries must be quite extensive in 
coverage, and considerable sifting of data is necessary in order to 
reduce all that has been obtained to some meaningful nucleus. As a 
result, much of the initial data (and tests) are in the end discarded. 
We shall now consider an approach which is more economical in 
this regard, but which is accompanied by still another persistent 
methodological problem. 


The Synthetic Approach 


The analytic personality model was constructed from an analysis 
of functional roles, the empirical model from a study of criterion 
subjects. The model need not be based on such direct observations, 
however. Any hypothetical personality type may be employed as a 
model, providing only that there are grounds for defining signifi- 
Cant consequences which can be expected to follow from the par- 
ticipation of representatives of the type in the particular situation 
in question. Chapter 10 describes an attempt to synthesize such a 
purely hypothetical personality model. In this case, a stereotypy 
Syndrome was hypothesized whose interaction within a program of 
general education could be foreseen in a number of specifiable ways. 

Fromythe clinical description of this syndrome, it was possible to 
deduce an ideological content or system of values peculiar to the 
basic personality structure postulated. A brief diagnostic device, 
the Inventory of Beliefs, was used to identify representatives of the 
syndrome among the student body. This test was developed by 
Stern in conjunction with the Attitudes Sub-Committee of the ACE 
Co-operative Study of Evaluation in General Education (19). The 
Inventory consists of 100 items relating to ideas, social institutions, 
Social groups, interpersonal relations, and self-concept, to which the 
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subject indicates agreement or disagreement on a four-point scale. 
It may be group-administered and machine-scored; interpretation 
is limited entirely to recognition of deviation from pre-established 
cut-off scores. 

Data regarding the subject’s internal frame of reference were 
obtained directly from this type of test—no further analysis or in- 
terpretation was necessary. On the basis of his score the individual 
was either categorized as a representative of the syndrome (or its 
polar opposite), or eliminated from further consideration. Specific 
predictions regarding the anticipated performance of representa- 
tives were made, and subsequently verified. 

It would seem that the synthetic approach offers an economical 
procedure which requires only limited testing. It is well-suited to 
the treatment of large groups, and there is no waste in the gathering 
or analysis of data. Its most serious disadvantage, however, lies in 
the fact that one can have no certainty of the relevance of a hypo- 
thetical typology for a particular situation. No representatives of 
such a typology may ever appear in the population studied. In order 
for this approach to be useful, there must exist some a priori 
grounds, preferably as a result of a prior analytic study, for inferring 
the relevance of a hypothetical model before any attempt is made 
to measure it by means of a paper-and-pencil derivative index. 

Once such a model has been synthesized, however, instruments 
can be developed which represent tests or indices of peripheral be- 
haviors associated with the underlying central personality structure. 
Thus, the synthetic approach illustrates an important way in which 
it is possible to proceed from relatively complex and subjective 
clinical procedures to simpler and more objective testing devices. 
The latter can be more direct and objective in form, although no 
less diagnostic, than the more indirect and unstructured instru- 
ments from which initial knowledge of the personality model in 
question was obtained. 

But, it will be objected, the synthetic model can account for only 
a limited proportion of the screened population. What of all the 
other subjects who don’t happen to match the particular hypotheti- 
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cal model which has been synthesized, but who may nevertheless be 
suitable material? There is, after all, no reason to be limited by the 
assumption that one and only one type of person will be capable of 
succeeding in any given situation. A number of variant configura- 
tions, each capable of achieving optimal performance in its own 
way, would seem rather likely. The last approach to be considered 
here, the configurational, would appear adequate to meet such a 


contingency. 


The Configurational Approach 


It is possible to conceive of an exaggeration of the empirical ap- 
proach in which the function of the assessment team has been re- 
duced to a single person—the statistician. The assessor in this in- 
stance is no longer concerned with the psychological content of his 
model, but is primarily interested in the scores on tests. His major 
concern is with the development of clusters of scales which will pro- 
vide a parsimonious breakdown of the specified criterion. 

But the derivation of a statistical equation which describes the 
rms of the most efficient arrangement of 


average group member in te 
y rests on the assumption that the 


the components of the test batter 
criterion for effective participation can be achieved only by those 
who share this same set of test characteristics. A statistical criterion, 
such as would be represented by letter grades, output, sales volume, 
missions flown, etc., is not only likely to involve a multiplicity of 
dimensions, however, but may even be achieved by a number of 
different combinations of these same dimensions. Experience with 
the derivation of a Rorschach “equation” characterizing pilots dur- 
ing World War II, for example, has indicated that such formulas 
may provide descriptions of an average case which is nonetheless 
atypical insofar as any individual subject is concerned—the popula- 
tion average in these instances simply provides a statistical compro- 
mise between several disparate sub-groups. 

A solution to this problem requires the development of statistical 
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procedures which will isolate sub-groups of persons who meet the 
same standards of criterion performance but form independent 
clusters with respect to representation within the screening battery. 
Our experience along these lines, described in Chapter 11, has been 
restricted to preliminary demonstrations of the applicability of 
transposed factor analysis to such a problem. Despite the limitations 
of these exploratory studies, they suggest that predictability from 
test factors can be enhanced considerably if the existence of in- 
dependent functional groups within the total sample of persons 
studied is first established. Personality models may be identified 
in this manner and translated directly into test specifications for 
new candidates. 

Despite the maximal economy of the configurational approach, it 
should be noted that the typologies obtained must still be inter- 
preted if their ramifications are to be understood and utilized ef- 
fectively. The configurational approach is not a substitute for the 
analysis required by an assessment methodology. It can provide a 
more efficient procedure for the gathering of relevant data, how- 
ever. Furthermore, the course of action suggested by this approach 
is of considerable significance for the actual application of assess- 
ment techniques to concrete selection problems. 


Summary 


The three alternative approaches suggested here—empirical, syn- 
thetic, and configurational—each represent a modification of the 
analytic methodology intended to increase its applicability to con- 
crete situations requiring improvement in the prediction of per- 
formance. Two of these alternatives, the empirical and the config- 
urational, attempt to reduce the high costs of the analytic method- 
ology by increasing the distance, both figuratively and literally, 
between the subject and the assessor. Both the empirical and the 
configurational approaches involve basic designs which have be- 
come fairly conventional in the field of psychological tests and 
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measurements. In both cases, however, we have suggested modifi- 
cations which appear to improve the usefulness of these approaches 
and which have rendered them more consistent with our initial re- 
flections regarding the analytic approach itself. 

The synthetic approach, on the other hand, represents a more 
radical departure from conventional methodology. Although ad- 
mirably suited to the screening of large numbers of personnel, and 
wholly independent of the assessors’ skill once the diagnostic test 
has been developed, it is nevertheless more closely related to the 
analytic approach than either of the two alternatives described 
above. The empirical approach takes as its starting point already 
differentiated groups of subjects and seeks to find further bases for 
discriminating between them. The configurational approach is 
ng discriminable clusters than it is with 


more concerned with isolati 
s which distinguish them. At best, in 


understanding the dimension 
accordance with the modifications previously suggested, the attempt 
might be made to construct personality models for the groups of 
subjects identified by means of these two approaches. However, a 


more faithful adaptation of the analytic approach to the require- 
ng would involve the development of paper- 


ments of mass screeni 
o a particular personality configuration, 


and-pencil indices specific t 
a procedure which is characteristic of the synthetic approach. 
Although each of these three alternatives is based upon a some- 


what different rationale, they all share the common characteristic 


of achieving practicability by replacing depth and projective tests 
with paper-and-pencil instruments. Despite the several advantages 
realized by this means, there are limitations inherent in such in- 
struments which must be kept in mind. 

A good many of the existing paper-and-pencil tests that have been 
developed in the past were so constructed that the subject could, 
without too much difficulty or psychological insight, assess what it 
was that the test constructor was after or what his values were. 
Knowing this, the subject could then furnish responses which are 
congruent with his own assessment of the situation. Thus, the stu- 
dent who realized that a test is designed to determine whether or 
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not he is “neurotic,” and that being “neurotic” is not a “good” 
characteristic, will alter his responses in such a fashion that he ap- 
pears non-neurotic even if he is so. 

A second objection is that the paper-and-pencil tests may not tap 
the significant variables. The assessor is not interested, for example, 
in whether the student is neurotic, but rather in the cause of the 
neurosis and how the subject deals with it. For it may well be that 
a subject appears as neurotic on a test, but the conflicts that cause 
this neurosis may not be stimulated or brought to the fore in the 
performance situation for which predictions are to be made. Fur- 
thermore, the paper-and-pencil tests that are available may test for 
emotional stability or values or social relationships, but may be un- 
able to measure the integration of these 
being studied. 

Thirdly, 
“cut-off poi 


in the single subject who is 


the paper-and-pencil tests will often yield “scores” and 


nts” and group individuals into categories, but they do 
not necessarily reveal the relevant data about a single case. Thus, 


for example, student Fred Jones may score low on the paper-and- 
pencil tests, thereby leading one to predict that he would not do 
well in situation X. But could one, on the basis of the scores alone, 
be ina position to help this student overcome some of his problems, 


reliable and valid test instruments, 
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In general, then, it would appear that the three alternative ap- 
proaches are not substitutes for the analytic methodology, but 
rather constitute alternative choices for subsequent stages of de- 
velopment in a full-fledged assessment program. In the remaining 
chapters of this volume examples of the application of each of these 
alternatives will be presented. In each case it will be evident that 
their major contribution lies in the provision of a practicable al- 
ternative to be used in implementing initial insights developed 
through a preliminary analytic assessment. Choosing among them 
involves an evaluation of the calculated risks which are peculiar to 
each, and the precise needs of the particular problem at hand. 
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Empirical Studies 
of Graduate Students’ 


IN THE PRECEDING CHAPTER, THREE SUPPLEMENTARY 


approaches in the design of assessment research were described. It 
Was suggested that these modifications offered a possible solution 


Ə 
to the limitations inherent in the analytic paradigm: high cost per 
lication in large-scale 


case and consequent impracticability of app 
screening operations. 

To illustrate the empiri 
remains with us from one of the stu 
our previous experience with the theologi 
rank-order of the teacher-trainees did not 
of the faculty. Could further testing and an 
of the nature of the apparent discrepancies in the model, making 
Possible a more precise reformulation? 

ding overall performance as 


Ratings provided by the faculty regar 
a good or poor student served as the criterion. The problem was to 


search for sources of material which would discriminate between 
these established “highs” and “Jows.” This attempt to uncover 
further signs of differentiation between such operationally defined 
criterion groups is basic to what has been referred to here as the 


cal approach we start with a problem that 
dies described earlier. Unlike 
cal students, the assessors’ 
agree perfectly with that 
alysis reveal something 


"A preliminary report on the studies referred to here is to be found in (62). 
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empirical approach. Unlike the conventional practice, however, 
our concern lies with the clarification and elaboration of a person- 
ality model for the hypothetical individual capable of optimal role- 
fulfillment, rather than with the mere discovery of empirical cor- 
relates to criterion performance. It was our hope, therefore, that 
this second analysis of the teacher-trainees might reveal something 
of the possibility of deriving a functional personality model analo- 
gous to that produced by means of analytic procedures, but without 
the attendant complexities and expenses. We were interested in 
seeing what kind of model would be developed solely through study 
of the empirically determined criterion groups of students. 

Two relatively new instruments were employed for these pur- 
poses with the teacher-trainees, and then the entire study was re- 
peated with a group of graduate students in physics for whom no 
contamination in the form of a prior analytic project had occurred. 
These two studies will be described in turn below, followed by a 


comparison of the models obtained with each of these groups as 
well as with the original group of theologians. 


An Empirical Study of 
Teacher-Trainees 


TESTING PROCEDURES 


The Wechsler-Bellevue and several projective tests had already 
been administered to the students in the teacher-training program, 
as discussed in Chapter 5. These same students were now given the 
Drawings test and the Activities Index, referred to in the previous 
chapter. Comparisons were then made between those students who 
had been rated high by the faculty and those who had been rated 
low. This same analysis was also applied to a series of essays on 
“Why I Want to Be a Teacher” which had been required of all ap- 
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plicants for admission to this training program. The results of this 


comparison follow. 


The Essays. The essays of the trainees regarding their reasons for 
wanting to be teachers contributed very little towards the differen- 
tiation of successful from unsuccessful students. Somewhat more 
serious personal problems could be inferred from the essays of the 
three lowest cases, such as withdrawal in daydreaming, excessive 
tenseness indicating depression, and feelings of persecution, but the 
difference between these and the highs was not marked. In the 
however, the essay content appeared to be 


remaining seven cases, 
vere encountered. 


more relevant, and fewer signs of anxiety V 
Wechsler-Bellevue. Tabulating the results of the Wechsler-Bellevue 
confirmed the original contention that intellectual level as shown 
by intelligence tests would not differentiate between successful and 
unsuccessful students in this training program for teachers. No 
evidence of any sort was found in the results of the Wechsler that 
would suggest differences in cognitive capacity. Thi 
1.Q. as well as scatter, and tends to eliminate the Wechsler as a 


necessary technique in this type of assessment. 


s was true for 


Rorschach. The data on the Rorschach, for successful and unsuc- 


c ‘ 
essful students, were as follows: 


l. Interpersonal Relations. The successful group is able to have greater 
maturity in interpersonal relations, possessing greater emotional 
stability and being able to be comfortably passive to a larger extent 

2. os the unsuccessful students. 
i State. Although not as sharply 
erences, the successful group generally h 
unsuccessful students are more cautious, 
spontaneity. They show a great deal more in 


3. ane limited and inflexible emotional controls. ai 

Goal Orientation. The unsuccessful students are more ambitious 

intellectually than the successful group. They are in need of an im- 
mediate sense of practical intellectual accomplishment, as opposed 
to the less material desire for personal development and growth 
characteristic of the successful students. The unsuccessful students 


defined as are the other dif- 
as a higher energy level. The 
constrained, and lacking in 
ner tension, and tend to 
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are less stable than the successful students, and are less capable of 
withstanding frustration. 


Drawings. The analysis of the drawings proved particularly useful. 
The subjects had been required to draw “a picture of a teacher at 
work in the classroom.” The successful and unsuccessful trainees 
differed quite sharply in their response to this task. The results are 
of the same nature as those found in the Rorschach and the Activ- 
ities Index to be reported below. The differences in the drawings of 
the two groups were as follows: = 

1. Successful trainees elaborated the figures and faces, giving 
each figure an aspect that set it off uniquely from the rest. This was 
true even in cases where stick figures were drawn. Embellishments 
included such things as facial expressions, posture, and clothing. 
Unsuccessful teachers drew figures that lacked individuality. They 
were stereotyped and stylized, and uniformity was emphasized. 

2. The successful group drew the children in activity, either 
among themselves or with the teacher. Separate clusters of children 
were drawn, grouped about a project table, a piano, etc., the teacher 
being pictured with only one of these, or even apart from them all. 
It was possible for the children in these drawings to be doing things 
which the teacher could not even see. By implication, control of 
children by the teacher in these drawings did not necessitate con- 
stant physical supervision. The teacher could tolerate activity not 
under her immediate control. This type of situation was not found 
in the drawings of the unsuccessful trainees. 

3. The unsuccessful trainees always indicated clearly in their 
drawings who the teacher figure was. They did this by increasing 
the teacher's size, putting her into a prominent position, and attach- 


ing some status symbol to the figure such as a ruler in her hand ora 


large brooch on her dress. In any case, casual inspection could im- 


mediately reveal the teacher in these drawings, which emphasized 
the authority of the teacher. The drawings of the successful trainees, 
on the other hand, emphasized what may be called the comrade- 
ship of the teacher with the children. In no case was the teacher 
figure clearly distinct by size, position, or symbol, and it was some- 
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times difficult to tell who the teacher in the drawing was. Usually 
the teacher was involved in activity with some of the children. 
4. The unsuccessful trainees emphasized order and regularity in 


their drawings. The children were arranged behind desks that were 
m, in the manner of the 


vs of X's were drawn to 
g that of the 


distributed systematically in the classroo: 
traditional schoolroom. In some cases roy 
indicate either desks or pupils, the only figure bein 
teacher. The successful trainees, in contrast, organized their draw- 
ings around groups of children engaged in some activity and work- 
ing together, even though sub-groups might be doing different 
things. Order of the type described above was entirely lacking. The 


unifying principle for the successful trainees seemed to be the re- 


lations of the people in the drawing, rather than the regimented 


lines of desks or pupils. 


5. The unsuccessful group paid much more attention to physical 


details in their drawings. These included blackboards with a variety 
of things written on them, books, rulers, erasers, and so on. These 
details were not always relevant. The successful trainees paid little 
attention to such details, concentrating more on the figures in the 
drawing. 

These drawings contributed a great deal to the assessors’ concep- 
tion of the hypothetical model, and were considered as one of the 
most valuable techniques employed. Their content is surprisingly 
Similar to drawings obtained by Travers and others (76), from 


teacher-trainees in New York City. 


om the Index for the teacher-trainees, 


Activities Index. The data fr 
of the subdivisions of the assessment 


when broken down in terms 
model, were as follows: 

ns. Both the successful and unsuccessful train- 
here. There is a great deal of interest 
hem. The level of maturity at which 
d, since strong egocentricity and de- 
for autonomy is missing. In com- 
to be described later, the teachers 
interpersonal relations than in 


l. Interpersonal Relatio 
ees showed a similar pattern 
in others and desire to give to t 
this operates must be questione! 
pendence are present. Evidence 
parison with a group of physicists, 


show their much greater interest in 
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strictly intellectual pursuits. The teachers are interested in their 
impulse life, want to give in to their impulses for sex and play, but 
have controls lurking in the background. Impulses for play, together 
with interest in change, suggest possible bases for identification with 
children as well as the capacity to face changing situations, such as a 
classroom which is in constant flux. Evidence for organization and 
integration is found, showing that the teachers are not overwhelmed 
by their impulses. 

2. Inner State. No particular emphasis on a high energy level was 

found in either group of trainees, This finding is unlike that postu- 
lated for the original analytic model. 

- Goal Orientation. The unsuccessful students showed a marked inter- 
est in immediate, practical gains. For the successful trainees dedica- 
tion in goal striving is indicated by lack of interest in immediate, 
concrete, and opportunistic problem-solving and rewards. Their in- 
tellectual interest is focussed less on practical ends and more on 
social action, ideals, scientific examination, and introspection. Simi- 
larly, no particular importance was attached by either group of 
trainees in the Activities Index to the necessity of striving actively 
against obstacles. On the other hand, the successful trainees in par- 
ticular emphasized strongly a need for change and novelty in an 
integrated framework, This desire appears to be independent of the 
influence of obstacles and stress. Actually, a willingness, in fact a 
desire, to meet new situations in which inhere the possibilities of 
failure and frustration, in itself is indicative of more than simply a 
counteractive attitude to obstacles as they occur, It demonstrates a 
search for possible obstacles. The unsuccessful trainees indicated 
much more caution and fear of danger and were less inclined to 
seek out novelty than were the successful trainees. This refers directly 
to the desire for change discussed above. The unsuccessful trainees’ 
caution was also demonstrated in their increased concern with order 


and organization. This finding parallels the interpretation of the 
Drawings, discussed previously. 


REFORMULATION 
The hypothetical model derived in the course of the analytic 


study was supported, by and large, in the current empirical analysis. 


Although some revision now appears to be in order, the faculty may 
be said to have judged the success of students in a 


dominantly consistent with their own verbalizations. 
However, 


fashion pre- 


the presence of one of the qualities considered desir- 
able by the faculty appears to be more the representation of a wish 
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on their part than an objective appraisal of student needs. Although 
the faculty emphasized independence as a desirable student char- 
acteristic, the assessors found, instead, the presence of dependency 


and passivity. Autonomy should be excluded from the model. Ap- 


parently, dependency is not considered as a totally wholesome or 


desirable quality by the faculty, although it is nevertheless actually 
characteristic of the students they rate as successful. The depend- 
SOY needs of these students may well be related to their strong 
desire to identify with children. Perhaps, in so doing, they are 
working out unsatisfied dependency relationships residual from 
their own childhood. From this point of view, a certain amount of 
dependency or succorance may be useful in 

Some modification is required in the interpret 
n factors by the assessors. 
rucial as it had at first appeared. Counter- 
action against frustration is now seen more as flexibility, desire for 


novelty, and the absence of excessive caution as manifested in either 
veness. With respect to interpersonal relations, 
t as criteria. Although all 


h oriented towards main- 
oiding rejection, the 
f relating ade- 
stained at a 


a teacher. 
ation and relative 


importance given certai Energy level as 


such is probably not as € 


anxiety or compulsi 
maturity and stability appear uppermos 


the trainees were found to be very muc 


taining friendly relations with others and av 
are also most capable o 


Most successful among them 

quately with others. Personal relationships are su 

Warmer and more intimate level, free emotional expression being 

less threatening to them. 
The results of this empi 

Criterion groups of teacher- 

planned. Although some indi 


model were obtained, these made no con 
e Cin the initial assessment reported 


erations continue to apply in fact 
rate estimate of the fac- 


rical analysis of data obtained from the 
trainees did not work out entirely as 


cations of discrepancies in the original 
tribution towards the re- 


evaluation of the disputed cas 
in Chapter 5. The same consid 
as had been suggested before—a more accu 
ulty’s reaction to student G would require attention to even subtler 


nuances of faculty behavior. The empirical approach contributes 
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nothing along these lines; only further analytic sessions with the 
teacher-training staff can provide the necessary clarification. 

The present empirical study has demonstrated considerable cor- 
respondence with the major parameters of the hypothetical model 
obtained using the analytic assessment approach. The substantial 
agreement found to exist in the results from the Activities Index 
and the Rorschach also suggest that a practical (if not precise) model 
for assessment purposes might be obtained by means of the more 
economical empirical design. Although the next phase of this ap- 
proach, the development of screening indices specific to the model 
for the optimal teacher-trainee, did not seem advisable due to the 
uncertainty of the future status of the training program itself, a 
second empirical study was begun with the students of another 
graduate school. The immediate purpose of this next study was to 
undertake the derivation of a functional personality model by 
means of a purely empirical design, in a setting which had not been 
open to bias from a prior analytic study as was the case with the 
teacher-trainees. 

A second purpose lay behind the proposed new investigation, a 
purpose which in fact dictated the selection of physics students in 
Particular as the subjects for this study. If the models for the theo- 
logical students and teacher-trainees are compared, it is apparent 
that a number of close parallels exist between the t 


wo. Both models 
were initially structured around four main elements and their in- 
terrelationships: sociability, high energy, counteraction, and pur- 
posiveness. Despite the minor variations in specific nuance, the gross 


communialities of the two models seemed to indicate the possibility 
of these findings being an artifact of the approach employed. These 
criteria could have represented our own projections, which we 
sought and found wherever we looked, rather than inherent at- 
tributes of the roles and Situations studied. As an alternative, such 
communalities might be accounted for by the fact that both groups 
had professional motivations in the social sciences, or simply be- 


cause these models represented common characteristics of graduate 
students regardless of area of subject matter. 


146 


Empirical Studies of Graduate Students 


In order to resolve this issue a third group, from a widely diver- 
Bene area of professional activity, seemed desirable. Student phys- 
icists were selected for this purpose. We shall first consider the find- 
ings abtained from an empirical analysis of successful students in 
physics. Following this a detailed comparison of students in each 
of the three fields will be made. 


An Empirical Study of Graduate 
Students in Physics 


d above, the Physics Department was 
ext demonstration of the empirical 


ies described previously, no formal 
time. However, it was 


For the reasons indicate! 
selected as the site for this n 


apo 
pproach. In contrast to the stud 


g i 
onferences with the faculty were held at any 
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gained as thorough an 


n ’'s i 
ot the assessment staff's inte 
u . - Ce j- 
nrealistically by avoiding knov 
pees : 
social setting. In fact, the staff, throug 


b a ; 
oth faculty and students 1n the department, 
awareness of the setting as is possible in this way. The roles of the 
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The ten most advanced stu 
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ould be presumed to be representa- 


tive of the successful student in physics, it seemed likely that the 
characteristics which they shared jn common would constitute a 


Potential model of the qualities making for success in this setting. 
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TESTING PROCEDURES 

The ten students were administered the following tests: Ror- 
schach, TAT, Sentence Completions, Drawings, and Activities In- 
dex. From the resulting data two independent models were con- 
structed. One was based exclusively on the scoring of the Activities 
Index, the other on the results of the projective tests. The two 
models were compared to note similarities and differences, and 
finally combined into a single model for the Physics Department. 
Scoring of the Activities Index was based on the scheme described 
previously, and interpretation of the projective tests done with the 
same framework of personality variables developed for the rest of 
these studies. 

In addition to the above, questionnaires were devised and sent 
to the ninety students then actively matriculating in the Physics 
Department, regardless of their educational level. Of these, forty- 
two were completed and returned to the assessment staff. The an- 
swers and comments of these respondents were studied for evidence 
of the qualities of the model inferred for the group of ten students. 
It was possible to see to what extent the questionnaire elicited data 
indicating the presence or absence of the hypothetical model in the 
general student body. In addition, some of the broader character- 


istics of the students, as well as aspects of the relation between the 
students and the administration were obtained fro 


í m the question- 
naires. 

Projective Test Results. The analysis of the projective data dis- 
closed several common qualities among the ten tested students that 
form a pattern of the sort that can be termed a hypothetical model. 
1. Interpersonal Relations. 


withdrawal, caution, ho 
discovered in this 


In one form or another, 
stility, 
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ally. The group tended towards being non-competitive and non- 
aggressive towards others, even submissive to a degree. Internally, 
these ten appeared limited in impulse acceptance and controlled in 
impulse expression. Although lacking in spontaneity, neither were 
they rigid. Instead, they seemed inclined to adopt a passive attitude 
towards their own impulses, on occasion being overwhelmed by 
them but experiencing no anxiety whenever such lapses in control 
occurred, Although all ten were dependent, their dependency needs 
were not conscious in all cases. 

2. Inner State. A high energy level was found. Energy is easily available 
for this group, both mentally and physically, and is pleasurably 
used. There is much intellectual curiosity and ambition, The content 
of thought is rich and interests are very broad and versatile. Energy 
is relevantly channelized. 

3. Goal Orientation. There was a complete and unrestrained emphasis 
placed upon a need for understanding, for disinterested speculation 
and abstraction engaged in and valued purely for its own sake as a 
source of satisfaction. All ten were preoccupied with problem-solving 

and its mechanics, with analysis, categorization, and reflection. Much 

emphasis on order, relevance, logic, and rationality was subsumed 
under the category of conjunctivity. A good deal of caution and 


deliberation was discovered, verging on outright compulsiveness. 


In response to frustration, the reaction is essentially one of counter- 
action. The majority work for the sake of research, but several have 


social approval as the predominant motive. 


one of the subjects follows, illustrating the man- 


A short sketch of 
expressed in one person. This sketch is 


ner in which this model is 
based on projective data only. 


l. Interpersonal Relations. Close interaction with others is avoided. 
This person is extremely passive and dependent, but he admits this 
only indirectly in such socially acceptable ways as nature apprecia- 
tion and reading. He appears to regard his dependency needs as 
dangerous, and seeks to conceal them behind a facade of detachment, 
reserve, and aloof superiority. Despite his considerable intellectual 
and manual competence, however, this is not an entirely successful 
line of defense. He continues to experience a generalized, non- 
specific tension which he cannot identify, and which apparently 
produces persistent feelings of vague depression. 

2. Inner State. He is highly energetic and works with an even, calculated 
effort which makes his performance seem smooth and relaxed. His 
strong need to achieve serves both to satisfy his personal aspirations, 
which are high, and his desire to receive recognition from others. 
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3. Goal Orientation. His goals are definite and high. He works toward 
them steadily and consistently. Anxiety, in general, is counteracted 
intellectually by examining objects, scrutinizing their parts and 
functions, and delving into their mechanism. Social frustration may 
well provoke increased interest in the anatomy and operation of 
things. In line with his high standards, he is highly critical, demand- 
ing much from himself and others. Everything must be handled in an 
orderly, predictable fashion, allowing only restrained emotional 


expression. He cautiously feels his ground, starting with the known, 


familiar, and protected, and then broadening his sphere of activity 
carefully. 


Although no quantitative analysis of the projective tests was at- 
tempted, two interesting observations are worthy of mention. In 
the Rorschach, an average of 2.8 responses per record for the ten 
subjects involved the use of, or comment on, the symmetry of the 
blot. In the drawings of the typical working situation for a physi- 
cist, a human figure was either omitted or attached as an after- 
thought, vastly overshadowed by scientific equipment and appara- 
tus. In most cases, facial features were not differentiated. These 


findings were taken to indicate strong evidence for a need to or- 
ganize, co-ordinate, 


deep involvement i 
scientific and vocati 


manipulate and control, detached from any 
n interpersonal affairs. Instead, emphasis on 
onal matters that are impersonal is clearly il- 
lustrated. As with the drawings by the teachers, the drawings by the 
physicists were of great discriminative value to the assessors. 

Activities Index. In the scoring of the Activities Index independ- 
ently, the categories that were found to be significant in the Index 


provided a basis for the following model common to the group of 
ten advanced physics students: 


y are not especially inter- 


and are relatively detached from others 
milarly, 


ifferent to striv- 


petition and aggressiveness. In 


order to achieve their own goals, which are different, they are willing 
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tive intellectual and analytic resources rather than an even more 
private and autistic fantasy life. Although this integrated and re- 
flective approach is maintained effectively in dealing with imper- 
sonal abstractions, it seems curiously inappropriate when it is em- 
ployed in the handling of interpersonal affairs and emotions. 

A particularly vivid illustration of this point was unwittingly 
given by the physics faculty itself. At the conclusion of the present 
study a formal report was submitted to them. During the course of 
the discussion which followed, the physicists indicated their accept- 
ance of all but one of the points being made here. Their objection 
was to the emphasis upon emotional constraints and controls, and 
they could not believe that they were any more lacking in spon- 
taneity than the theologians or teacher-trainees, for example. In 
order to make this point clear to the assessment staff, one of the most 


prominent physicists in the country who was then a member of this 
faculty told the following anecdote: 


Not long ago, one of the members of our staff was thinking of getting 
married. In the course of his deliberations he decided to draw up a 
ledger sheet on the proposed courses of action and perhaps strike some 
kind of meaningful balance. Accordingly, he listed a column of “credits” 
which cited all the reasons in favor of marriage with this particular 
girl, and a “debit” column which included all the arguments against 
pay sad ae As it happened, other members of the staff 
Ce nene oÈ T et, an a considerable amount of laughter arose at 
ler ching as un ortunate staff member, Surely this proved that 

all at least was not lacking in humor and spontaneity. 


The point seemed well-taken, and it was no more than force of 
habit rather than shrewd insight which led one of the assessors to 
inquire finally just why the other staff members had found the in- 
cident so funny. The reply was given immediately: it was because 
the fellow had been so foolish as to leave his list lying around! 


a further discussion of this point was fruitless. This in- 
cident in itself suggests the extent to which intellectualization ap- 


oo serves as a substitute for the more effective management 
: gas Saija relations. It is of interest to note that Roe (52), in 
er studies of eminent physical scientists, has also remarked upon 
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the marked independence and lack of involvement in personal re- 
lationships, the restricted psychosocial development, and the ab- 
sorbing devotion to work involving intellectualized forms of satis- 
faction, which characterizes such professionals. 

The significance of these same factors has recently been stressed 
by Kubie (35, 36). Such impersonal detachment may presumably 
stem from anxieties relating to unresolved dependency needs and 
masculine identification. To go into further details on this line 
would lead into excessive speculation. However, it does integrate 
the pattern of the model dynamically, showing the emotional basis 
that can lead to it. This, of course, does not imply that an emotional 
problem necessarily exists for such persons, but rather shows the 
defensive problem-solving which may underlie this particular per- 
sonality configuration. It is along these lines that further evidence 
for personality factors in vocational choice, as well as vocational 
success, seems most likely to be found. 

The final model for these graduate students in physics, integrat- 
ing all the evidence, can be stated in three major categories, each 
crucial in the pattern and having a number of finer internal distinc- 
tions: 

1. Interpersonal Relations. Detachment from interpersonal relations 
and impulses. This aids in avoiding competition and emphasizes 


emotional control and unconscious dependency. 
2. Inner State. Energy and intellect are closely related in that a tre- 


mendous amount of energy is channelled into a versatile variety of 
ons, including introspection. 


very effective intellectual functi 0 , 
3. Goal Orientation. Unless matters can be managed in an organized, 


integrated, logical, rational and deliberate manner, they are avoided. 
Much caution and compulsiveness are necessary, as is persistence in 


problem-solving in spite of obstacles. 


Having developed the hypothetic 


data obtained from the projective tests and th 
final check on its validity was attempted by means of a question- 
theological seminary, which had 
e Physics Depart- 
d on the basis of 


al model in accordance with 
e Activities Index, a 


naire similar to that used at the 
been circulated to the entire student body in th 
ment. The items in the questionnaire were score 
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the model described above, in order to determine the extent to 
which the general student body shared the characteristics of the 
model. Tabulations were made of each item which elicited a re- 
sponse scorable for any of the major categories or sub-categories of 
the model. Questionnaires were returned by only forty-two of the 
ninety subjects. The low return is interesting; in the theological 
school 100 per cent participation was obtained under almost identi- 
cal circumstances. Almost all the physics students who returned the 
questionnaire indicated resentment at being asked to respond to 
such “personal” questions. This would seem to be consistent with 
what has already been said of this group. Perhaps the non-respond- 
ents are even more exaggerated in their need to remain detached 
and inviolate. Whatever the cause may be, and despite the possibly 
biased nature of this sample, it will be noted that even the general 
results summarized below conform essentially to the model as pre- 
viously specified. 

Outstanding in the responses to the questionnaire appear to be 
the detachment from people, and the exceptional emphasis on in- 
tellectual matters in which a great amount of energy is invested. A 
minority do not fit the picture of detachment, but almost all indi- 
cate intellectuality. The need for integration and organization 
arises by implication in the rational, practical, and thorough ap- 
proach most students take. About a third seem particularly intro- 
spective, and another substantial minority are the victims of psy- 
chological upset bearing on symptoms of depression, fatigue, and 
organic complaints. A large number of students turn away from 
others, as well as themselves, because of anxiety. In addition, these 
data reflect the retiring, almost fearful, attitude of a number of the 
students regarding practical vocational success. 

The results of the questionnaire can be taken as an indication 
that many of the students in the department probably reflect the 
hypothetical model to a considerable degree. Although the ques- 
tionnaire is incapable of revealing the model, being based on a 
heterogeneous assortment of students at all levels of training in the 
department, it may have some utility as a screening device once the 
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dimensions of the model have been otherwise elaborated. Before 
turning to the question of developing derivative indices for screen- 
ing purposes, it will prove profitable to contrast the models which 
have been constructed for the three groups of graduate students 
studied thus far. This comparison will facilitate an evaluation of 
the results obtained to this point, and will clarify the nature of the 


task which follows. 


A Comparison of Theologians, 

Teachers, and Physicists 

It was indicated earlier that one of the concerns which led to a 
study of physicists involved the degree of similarity which had been 
found in the previously constructed models for theological students 
and teacher-trainees. The data presented on the physicists have al- 
ready provided sufficient evidence that this group differs in many 
respects from the other two. A more systematic analysis of the simi- 
larities and differences between the three groups, based entirely on 
quantitative results from the Activities Index, reveals the follow- 


ing: 


1. Theologians, teachers and physicists were alike in the following ways: 
a. Goal Orientation. All three groups indicated interest in intellec- 
tual activities involving ideals and their implementation, in reflec- 
tion upon social phenomena, and in personal introspection. The 
latter two characteristics were particularly emphasized by theologians 
and physicists. All three groups indicated a need to avoid situations 
which might result in physical harm. The co-ordination and integra- 
tion of activities was stressed by all three groups. 

2. Variables significant for theologians and teachers only: 

a. Interpersonal Relations. Most important for both these groups 
was the desire to be friendly, maximizing reciprocal interaction with 
others, In this connection both dependence on others for assistance, 
support, and protection, and the desire to support others by provid- 
ing these qualities, was found. Although this combination of qualities 
characterized both groups, the teachers tended towards greater nur- 
turance of others, whereas the theologians were somewhat more 
openly succorant or dependent upon others. 

b. Inner State. The teachers and, to only a slightly lesser degree, the 
theologians both indicate erotic interest and value amusement and 
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entertainment, The teachers and theologians appear to accept these 
impulses without conflict, although some degree of uncertainty re- 
garding impulse control is apparent. This may in part be attribu- 
table to the difficulty of distinguishing by means of the Index be- 
tween control predicated upon the avoidance of disapproval and 
that associated with anxiety arising from incomplete acceptance of 
the control. The teachers are clearly interested in unroutinized, 
labile, and changeable behavior, involving novelty and lacking in 
permanence. In this respect the theologians are somewhat less labile 
and changeable, but are clearly more similar to the teachers than to 
the physicists. 

3. Variables significant for physicists only composed this pattern: 
a. Interpersonal Relations. There was no interest in any of the 
variables in this dimension. In a much less direct fashion, the physi- 
cists indicated that independence and self-sufficiency were important. 
b. Inner State. Again, in an indirect and equivocal way, erotic 
interest and desire to satisfy sensual needs appeared. No significant 
reference to controls occurred. Energy is easily liberated and can be 
sustained, There are again indirect signs of ambivalence about drives 
for achievement, suggesting that in certain situations full energy can- 
not be used. 
G Goal Orientation. The physicists, in addition to the intellectual 
functions considered in the section on shared qualities for all three 
groups, also indicate interest in reflections about physical phenomena 
as well as in intellectualization purely as an end in itself. Also strik- 
ing is the desire to manipulate external objects in a practical and 
predictable framework. The physicists stress the importance of re- 
striving to overcome experienced frustration, failure, or humiliation. 
There is indirect interest in concealing or justifying failure or hu- 
miliation, The behavior chosen here as most desirable is hesitant, 
cautious, and deliberative. There is a considerable lack of spon- 
taneity, in marked contrast to the other two groups. 


These divisions, of course, are arbitrarily set in order to maxi- 
mize the differences between the three groups. There are also a 


number of apparent similarities which may be shown in future re- 


search to represent elements shared by a wide range of graduate 
students, at least in this particular institution. 


The communalities among the three groups include a tendency 
towards organized and systematic thinking. This indicates a stable 
approach to problems, thus insuring consistent problem-solving, or 
attempts in that direction. Introspection and social conscience also 
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appear, indicating that for these fields of study, goals are not strictly 
materially oriented, and satisfaction is derived from other, internal, 


sources. 
An even more marked similarity exists between the models for 


teachers and theologians. Both emphasize mature interrelationships 
with others, and expend much energy in the development of good 
interpersonal relations. The teachers appear to employ such inter- 
personal skills primarily as subsidiary devices in the transmission 
of educational materials, whereas the theologians may be said to 
have professionalized interpersonal relations. It appears as a central 
core around which they have organized their interests in instilling a 
way of life and an ethic in others. 

The physicists resemble neither of these groups in this matter, 
being concerned predominantly with intellectual activities rather 
than with relations to people. In some respects, however, the theo- 
logians share this interest in abstract and theoretical matters. The 
physicists, on their part, also share some of the theologians’ personal 
introspectiveness, a characteristic not present in the teachers to the 
same degree. 

The most cursory inspection suffices for an appreciation of the 
teachers’ and theologians’ great concern with interpersonal rela- 
tions, and the physicists’ equally great affinity for strictly intellec- 
tual matters. Similarly, teachers and theologians are more inter- 
ested in their impulses, but also have pangs of conscience that 
physicists evidently avoid. Finally, while the physicists are doggedly 
pursuing ideas and keeping themselves in careful control, the min- 
isters are engaged in the search for universals and their translation 
into behavioral proscriptions to be transmitted to others, and the 
teachers are involved in providing security and support for the 
young. Although the present studies are far from conclusive, and 
extensive investigations of students in other professions and of other 
institutions are clearly required, these results would suggest general 
patterns characteristic of graduate students, group patterns differ- 
entiating between people in the social and physical sciences, and 
specific patterns peculiar to respective vocations. The very specifi- 
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city of these patterns would seem to indicate the directive antes 
ersonal needs in channeling individuals to the various pro = : 3 
T procedures would appear to offer vital re ens y 
ing the nature of such needs, both in terms of individua = j ro 
well as for particular vocational roles, in order to maximize 
efficiency of this process of self-selection. 


Summary 


It has been possible to obtain a hypothetical model for the ASSeSS- 
ment of physics students in a somewhat more economical fashion 
than for the teachers or theologians. The model obtained by means 
of the empirical approach appears adequate, insofar as it is reflected 
in evidence from several different techniques and is to be found 
represented to some degree within the total population of students 
in the department as well as among physical scientists studied by 
other investigators. What kind of significance can be attached to 
these results? 

It is true that the physics study, unlike its predecessors, has suc- 
ceeded in producing a hypothetical model with far less dependence 
upon preliminary explorations with the faculty. What has been 
done in effect was to replace the direct probe of the faculty, in order 
to obtain information regarding their bases for identification and 
projection, with a study of the designated objects of their choice. 
The faculty’s selection of the ten students provided the ad hoc cri- 
terion, the content of which was determined indirectly in this case 
by studying these students, rather than directly by means of exten- 
sive interviews with the faculty itself. 

The indirect procedure yields somewhat less information than 
the direct one, a difference of roughly the same order as that found 
between the Activities Index and the Rorschach. Whether the ad- 
ditional information is worth the cost of obtaining it still remains 
to be seen. Even the more restricted techniques appear to yield a 


considerable amount regarding the personality dynamics lying be- 
hind optimal performance in the selected situation. 
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Any attempt to undertake a rigorous evaluation of the signifi- 
cance to be attached to this differential increment of information 
would be patently premature. There are other problems of more 
immediate concern to us. To begin with, we still do not know how 
well the model obtained by means of the empirical approach will 
serve for actual predictions of performance. In the case of the theo- 
logians and teachers a post-diction process had been employed for 
this purpose, but no such evidence has been offered for the physi- 
cists. How, in fact, is this approach to be used in the development 
of screening instruments? 

We could of course return to the elaborate psychodiagnostic pro- 
cedures which had been used before, assessing the correspondence 
between model and subject. But the purpose of the empirical ap- 
proach is not only to provide more parsimonious procedures for 
the development of the criterion model; it is also intended to serve 
as a guide in the construction of more economical diagnostic de- 
vices. For this we must return to the details of the model itself. The 
parameters of the model must be forced to yield dimensions which 
can be translated into specific test items which will discriminate 
representatives of the model from those who are unlike it. 

Thus, in selecting physicists, an objective test battery must be 
designed to yield evidence regarding a lack of concern with inter- 
personal skills, a versatile and energetic intellect, and a character- 
istic use of systematic conceptual reductionism in the analysis of 
objective systems. Operational definitions of such propositions in 
terms of test items can be developed. In the chapter which follows 
an illustration of such procedures will be given. An even more 
readily available test, however, lies in the sub-scales of the Activities 
Index itself, based on those dimensions which had already proved 
to differentiate relevant aspects of the criterion model. The use of 
the Index in this fashion will also be demonstrated in the next 
chapter. 

But there is another question raised by the empirical approach 
which concerns the kind of criterion that has been used thus far. 
The analytic methodology has been based on the assumption that 
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the most accurate prediction of performance in the classroom can 
be made by going directly to the source of evaluation for that per- 
formance. It is not an abstract competence that is being predicted, 
but rather the response of a teacher or evaluator. Now this response 
may involve interpersonal relationships, but what of other criteria 
which do not depend upon the idiosyncrasies of an evaluator? 
Would the development of a hypothetical personality model for 
the optimal performer make as much sense if we were predicting 
work output, for example, instead of the ratings of a supervisor? 
The next study will take this problem into account as well, by sub- 
stituting more impersonal criteria of performance for those pre- 


viously used, without otherwise modifying the basic empirical ap- 
proach. 
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CHAPTER 9 


An Empirical Study of 
College Freshmen 


THE PRECEDING STUDIES, BOTH analytic AND empiri- 
cal, have been based upon a very simple and straightforward as- 
sumption. It has been assumed that the basic dimensions of aca- 
demic achievement are to be found by studying the teacher's 
evaluation and not the student’s performance. It is the evaluation 
which is being predicted, rather than the performance. In fact, the 
latter has no particular meaning except insofar as some evaluative 
judgment has been placed upon it. 

It has been suggested, furthermore, that this evaluation does not 
constitute a detached appraisal of some abstract skill, but represents 
instead a teacher’s judgment regarding the extent to which a given 
student has succeeded in fulfilling an idealized role. We have 
shown that the adequacy with which such roles can be fulfilled de- 
pends upon the existence of compatible personality configurations, 
thus enabling us to make quite accurate predictions of faculty evalu- 
ation simply by assessing the similarity between the optimal con- 
figuration and that of a given student. 

These same procedures would apply in many other cases where 
performance is essentially a matter of fulfilling the expectancies of 
some other person. They would be relevant, presumably, for pre- 
dicting job ratings by supervisors, sales potential in a specified con- 
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sumer market, leadership capacity for designated work groups, ete: 
But what of those situations where the performance does not in- 
volve an interpersonal relationship? Will it be possible to construct 
personality models for optimal performers in such cases? And will 
such models enable us to make more accurate predictions of the 
performance in question, or will we find that the major contribu- 
tion comes from measures of cognitive and motor skills? 


Examination Performance: An 
Objective Criterion 


The present study was undertaken in a college setting peculiarly 
appropriate for an investigation of these questions. Unlike most 
American colleges, the major criterion of student achievement in 
this institution is entirely free from interpersonal judgments by the 
instructors. Grades are based exclusively upon the results of per- 
formance on comprehensive examinations which are devised, ad- 
ministered, and graded by a group of examiners maintained inde- 
pendently from the instructional staff. 

Student achievement under these circumstances would seem as if 
it were most likely to be a function of ability to master the required 
material, an ability dependent largely upon general intelligence 
and a number of cognitive factors specific to various subject matters 
or performance areas. Let us explore a line of reasoning restricted 
exclusively to this framework before we proceed to a consideration 
of the personality factors that may be involved. The comprehensive 
examinations are highly objective instruments which are graded 
without knowledge of the identity and characteristics of the indi- 
vidual student. Multiple-choice questions are scored by clerical 
workers or machines, while essay questions are graded independ- 
ently by two or more competent readers. These examinations 
(which are usually six hours or more in length) are highly reliable, 
and each contains an extensive sample of the types of problems and 
tasks which characterize the objectives of the course as well as its 
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subject matter. The comprehensives are highly valid examinations, 
designed by the examiners and the teaching staff to conform to the 
specifications for the course. They are undoubtedly the most care- 
fully constructed achievement examinations to be found anywhere 
in the country, and in many ways form an ideal criterion of learning 
outcomes. 

Sixty-three freshmen, entering the College at the 11th grade level 
and averaging 16 years in age, were selected as subjects for the pres- 
ent study. In contrast with the usual registration procedures, these 
sixty-three were divided into three equal blocks of students, each 
block being assigned to a common set of courses and instructors for 
the first year. This block registration procedure made it very con- 
venient to secure data about the students, either through classroom 
observations or by means of judgments from instructors and ad- 
visers. A special battery of tests, questionnaires, and interviews was 
administered to the students in the block groups which shall be 
analyzed here in relation to grade average based on the three or 
four comprehensive examinations taken by the student at the end 
of his first academic year. It should be pointed out, however, that it 
was not possible to secure complete co-operation from all the stu- 
dents in the block groups. Some data were obtained on all sixty- 
three students, but data on the full battery were obtained only on a 
group of forty-five. For this reason the analyses of the data will vary 
from a sample of forty-five students to a sample of sixty-three, de- 
pending upon the particular instruments involved. 


Testing Procedures 


SCHOLASTIC APTITUDE 
The most logical predictor of achievement to be considered 
would be an index of intelligence or scholastic aptitude. For this 
purpose the ACE Psychological Examination was used yielding a 
correlation of +.17 with grade average on the comprehensive ex- 
aminations. This correlation is not significantly different from zero. 
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In part this can be attributed to the great homogeneity of the Col- 
lege population with regard to scholastic aptitude, resulting from 
the initial selection of these students for admission to the College 
on the basis of their performance on this test. The average standing 
for entering classes in this College over the last several years has 
been consistently above the 90th percentile on national norms for 
college freshmen. It should be noted that even though some stu- 
dents with relatively low scores on scholastic aptitude may be ad- 
mitted to the College, these are likely to be students for whom there 
is some question about the appropriateness of the test because of 
language handicaps or the speed element, or they are individuals 
whose performance on other aptitude tests, such as reading and 
vocabulary, have been relatively high. Despite the effects of homo- 
geneity, however, the low correlation is especially surprising since 
this particular scholastic aptitude test is one of the most widely used 
predictors of scholastic achievement. The very low relationship ob- 
tained here is a striking demonstration of the need for other pre- 
dictors of achievement, especially where the student body is homo- 
geneous with regard to this variable as is the case in the College. 


PERCEPTUAL-COGNITIVE PROCESSES 


Studies by Bloom (4), Goldner (27), and Walker (77), have sug- 
gested relationships between certain perceptual-cognitive processes 
and the ability to learn highly abstract and complex forms of prob- 
lem-solving such as has been embodied in the comprehensive ex- 
aminations. Evidence on relevant perceptual patterns was obtained 
from a number of tests which included the following. 


Physiognomic Cues. This is a test devised by Stein, Stern, and Lane 


which offers the subject a series of simple but ambiguous drawings. 
The subject is to indicate on a continuum which of two names best 
applies to his perception of the figure. One name of e 
to the literal shape of the figure (i.e. 
tangles, 


ach pair refers 
, diagonal lines, three rec- 


rising loops, etc.), while the other describes an inferential 
abstraction or feeling state ( 


i.e., rain, crashing boats, feeling of ela- 
tion, etc. 


). The subject's final score was based on the number of ab- 
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stract or tending to abstract references he checked. It was thought 
that perhaps abstractedness of perception would correlate positively 
with grade average. 

Thurstone Factors. Three factors isolated by Thurstone (70, 72) 
were each represented by three tests in a battery administered to the 
block registrants. The first was a speed of closure factor, involving 
the “ability to fuse a relatively unstructured field into a single per- 
cept,” and measured here by means of the Street-Gestalt, Mutilated 
Words, and Hidden Pictures. The second, flexibility of closure, de- 
fined as “the ability to hold a configuration against a distracting 
background,” was measured with the Gottschaldt Figures, Copying, 
and Designs tests. The third factor was a space factor involving the 
“ability to visualize a rigid configuration when moved into differ- 
ent positions.” Three brief tests with high loadings on this factor 
were employed: Flags, Figures, and Cards. 

It had been predicted that all three of these factors would be cor- 
related with the examination grade average, although not in the 
same direction. Speed of closure was expected to be negatively re- 
lated to the achievement criterion, based on the view that as the 
speed with which an individual attempts to order phenomena in- 
creases he becomes unable to order other than simple phenomena, 
or the ways in which he orders complex phenomena are likely to 
become faulty or inaccurate. Another way of stating this is to say 
that complex thinking involves reflection, suspended judgment, and 
some effort to see all the relevant aspects of the problem before a 
solution is reached; performance on the achievement examinations 
would therefore be expected to require relatively slow rather than 
rapid closure. Flexibility of closure and the space factor were both 
expected to correlate positively with the criterion, on the assump- 
tion that both involve the ability to see the same phenomenon from 
more than one point of view. This was assumed to be especially criti- 
cal in complex problem-solving which involves many elements that 
can be combined only after they have been seen in several possible 
relationships. The first view of the problem or solution is not likely 
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to be adequate or accurate; it is only as the individual is free to view 
it in different ways that he can solve such complex tasks. 
Stimulus-Free Problem-Solving. This is a test developed by Walker 
(77) to measure the extent to which individuals habitually make use 
of abstractions and principles in their problem-solving as contrasted 
with solutions based on concrete characteristics specific to each task. 
It was proposed that increasing complexity in problem-solving 
would be positively related to stimulus-free thinking, negatively 
related to stimulus-bound patterns of thought. 
Results. With the exception of the space factor, none of these per- 
ceptual-cognitive tests yielded correlations significantly different 
from zero with the achievement test criterion (see Table 4, p. 171). 
Although the original predictions seem neither illogical nor ex- 
travagant, and find a measure of support in prior research, in this 
Instance no useful relationships could be demonstrated. Again it 
might be argued that the uniformly high intelligence of the present 
sample had mitigated against significant findings, although this 
makes the unaccounted high positive correlation with the space tests 
(r + .47, significant at the .01 level) even more puzzling. In the ab- 
sence of further information regarding the peculiar significance of 
the space factor, we are forced to conclude that some factor or fac- 
tors other than those represented by intelligence or cognition are 


involved in achievement on the College comprehensive examina- 
tions. 


OTHER MEASURES 


Attitudes. Still another attempt to understand and predict scholas- 
tic achievement was through the use of an attitude test. Although at- 
titude testers, in general, have usually found relatively low relation- 
ships between verbalized expressions of attitudes and measures of 
academic achievement, we were of the opinion that the test of 


stereotypy developed by Stern in connection with the Co 


7 -operative 
Study in General Education (19) 


might be predictive in the present 
study. This test of stereotypy yields an index of the extent to which 
an individual has difficulty in departing from traditional and cus- 
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tomary ways of viewing phenomena and is indicative of the need 
for order and closure in his many relations with the world. The 
hypothesis which we were investigating was that such attitudes and 
views hinder the person in attacking complex problems, especially 
in areas where a high degree of objectivity is required and in which 
the individual must prevent his own values and interests from in- 
terfering with the problem-solving task. 

The research on this test is reported at some length in Chapter 10, 

which deals with the typology represented by these attitudes. In the 
present study, utilizing the total score range we find a correlation 
of +.17 between performance on the Inventory and overall grade 
achievement, which is of the same order of magnitude obtained 
with the cognitive and perceptual tests and not significantly differ- 
ent from zero. It is apparently necessary to look elsewhere for an 
adequate accounting of the achievement criterion. 
Relevant Thinking in the Classroom. The students in the block 
registration program were observed in a number of classes and in- 
terviewed by the method of stimulated recall developed by Bloom 
(3). This procedure involves playing back a recording of a complete 
class discussion to each of the participants individually, eliciting a 
running commentary from them regarding the things they had been 
thinking about at various points in the class session. These thoughts 
were then classified in terms of their relationship to the topic or 
problem being discussed at the time, and an index was derived to 
represent the approximate proportion of the thoughts which were 
relevant. The values of this index for the subjects in this study were 
found to range from almost zero to 100 per cent. 

The estimate of relevant thinking which was obtained by means 
of the stimulated-recall technique apparently has no relationship to 
scholastic aptitude as measured by the ACE Psychological Examina- 
tion. The correlation between the two is —.01, and an inspection of 
the scatterplot indicates that the greatest amount of relevant think- 
ing is done by students who are slightly below average in scholastic 
aptitude. A relatively low proportion of relevant thinking is done 
by the students at either extreme of the distribution on intelligence, 
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which is perhaps related to the fact that the instructor attempts to 
ask questions and direct the discussion in tems at the average sti 
dent in the class rather than the extremes. The irrelevant thinking 
of the high aptitude students can possibly be explained as the re- 
sult of familiarity with the ideas under consideration and conse- 
quent boredom with the classroom proceedings, whereas the stu- 
dents with low scholastic aptitude may have difficulty in compre- 
hending what is going on and are therefore more susceptible to 
distractions. 

Relevant thinking was also unrelated to the perceptual-cognitive 
tests and to the measure of stereotypy in thinking. As an index of 
achievement, however, it proved highly significant. A correlation 
of + .61 (significant at the .01 level) was obtained between the ex- 
tent of relevant thinking in the classroom and average comprehen- 
sive examination performance at the end of the year. Insofar as the 
measure of relevant thinking reflects the extent to which individuals 
are engaging in activities relevant to the learning situations in the 
classroom, these results indicate that such relevant thinking is an 
important factor in contributing to success in problem-solving of 
the type sampled on the comprehensive examinations. 

Instructor Ratings. Another measure of student behavior was ob- 
tained from a series of rating scales filled out by the instructors and 
dormitory counsellors associated with the block registrants. These 
scales are reproduced in Table 3. In addition to the scores on each 


individual scale, the average rating over all scales was obtained in 


order to yield an overall value. 


Table 3. Rating Scales Employed with Instructors and Dormitory Counsellors 


A—OPEN-MINDEDNESS 

5 Discriminating: Welcomes new ideas and experiences, but habitually suspends judgment 
until all the available evidence is obtained. 

4 Tolerant: Does not readily appreciate or respond to opposing viewpoints and new ideas, 
although he is tolerant of them and consciously tries to suspend judgment regarding 
them. 

3 Passive: Tolerance of the new or different is passive, 
nection. Welcomes, or is indifferent to, chan: 
preciation of the new or of that which it re 

2 Rigid: Preconceived ideas and prejudices so 
discussion or an investigation without chang 


arising from lack of interest or con- 
ge because of lack of understanding or ap- 
places. 


govern his thinking that he usually ends a 
e of opinion, 
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Intolerant: Is actively intolerant: resists any interference with his habitual beliefs, ideas, 

and procedures. 
B—TYPE OF SOCIAL PARTICIPATION 
(Dormitory counsellors only) 

Secure: Appears to feel secure in his social relationships and is accepted by the groups of 
which he is a part. 

Uncertain: Appears to have some anxiety about his social relationships, although he is 
accepted by the groups of which he is a part. 

Unsuccessful: Shows the desire to have an established place in a group, but, in general, 
fails to find full acceptance. 

Rejected: Attempts to find a place in a group but is not accepted and, in some cases, is 
actively rejected by others. Gets along poorly with, and is avoided by, others. 

Withdrawn: Withdraws from others and does not make an active attempt to find a place 
in a social group. He is not a fully accepted member of a group. Seclusive, unfriendly, 
absorbed in self. 

C—EXTENT OF SOCIAL PARTICIPATION 
(Dormitory counsellors only) 

Very active. Participates in a wide variety of social activities. Seeks contact with others 
and is sought after in turn. 

Friends generally limited to small, intimate groups, frequently work-oriented rather than 


social or convivial. 
Completely self-contained—neither seeking others nor being sought after. 


D—EMOTIONAL ADJUSTMENT 

Responds readily, positively, enthusiastically to new situations and problems. Generally 
free from worry. Pleasantly self-assured. May be occasionally upset or irritable on 
reasonable provocation. Reacts in terms of his understanding of the emotion rather 
than in terms of the emotion itself. 

General adjustment apparently good, but not always sure of self. 

Usually gives overt impression of emotional control, but from time to time “spills over.” 
Generally little insight into own emotional reactions and becomes upset emotionally 
out of proportion to provocation. Often inflexible and fearful in the face of new situa- 
tions. Tends to blame others. 

Lacks emotional control. Sullen, complaining, irritable, antagonistic. No humor. Rapid and 
perhaps violent shifts in mood. Volatile. Nervous and tense. Persistent worrier. Ex- 
cessively inhibited, inflexible. Weeps on slight provocation. 


E—EXTENT OF CLASS PARTICIPATION 
(Instructors only) 
Very active. Involved in most discussions. 
Participates about an average amount. Volunteers when he is especially interested in 
the topic or point. 
Seldom participates. Usually has to be called upon to get him to speak. 
Participates very rarely and only after considerable prodding. 


F—QUALITY OF PARTICIPATION IN CLASS 
(Instructors only) 
Is chiefly a contributor of ideas to the discussion. Usually the ideas are sound and rep- 
resent distinct contributions. 
Is chiefly a critic and evaluator. He assumes the function of testing the ideas of others and 
frequently is able to point out what is wrong with someone else’s contribution. 
His contributions are limited to quotations from the text or to mere agreement or dissent. 


Not able to add much to the discussion. 
His contributions are usually irrelevant, misleading, or wrong. He does much to confuse 


the discussions. 
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G—POTENTIALITY FOR GROWTH AND DEVELOPMENT 

4 Likely to show a great deal of development—time spent with this individual should result 
in continuous progress for him, and it should be enjoyable and profitable for the in- 
structor. 

3 Likely to show moderate development—time spent with this individual should be profit- 
able both for him and for the instructor. There are, nevertheless, limitations to his de- 
velopment which will be reached in time. 

2 Likely to show some development—while time spent with this individual will not be 
wasted, the value either for him or for the instructor is greatly limited. 


1 Likely to show little or no development—time spent with this individual will be largely 
wasted, and unpleasant for the instructor. 


With the exception of the scale on Open-Mindedness, all of the 
instructor’s ratings correlated at the .01 level or better with ex- 
amination performance. The highest relationship (+.67) was 
found for the ratings on Quality of Classroom Participation, sug- 
gesting that the criteria employed by the instructors in judging 
student effectiveness in the classroom are closely related to the cri- 
teria embodied in the final examinations. Ratings by the dormitory 
counsellors, on the other hand, are uniformly low in their relation- 
ship to academic achievement. Apparently neither emotional ad- 
Justment nor social participation, as reflected in these ratings, are 
of great significance in predicting (or explaining) performance on 
the comprehensive examinations. 


SUMMARY AND DISCUSSION 

The study thus far has followed fairly conventional lines, in that 
we have attempted to predict an important criterion, academic 
achievement (average performance on the comprehensive examina- 
tions), by means of a number of other measures which seemed likely 
to yield significant correlations. The measures employed, and their 
relationships to the criterion, are summarized in Table 4. As has 
already been noted, the only measures which appear to be related 
to the criterion are Thurstone’s space factor, relevant thinking in 
the classroom, and the instructor's ratings of classroom participa- 
tion. 

The performance of the space tests is interesting, but perplexing. 
They correlate with achievement and with relevant thinking, al- 
though tests of the other closure factors failed to do so, and as 
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Table 4. Correlations Between Various Test Scores and Comprehensive 
Examination Results 


Comprehensive 


Examination Relevant 
Grade Average Thinking 
Scholastic Aptitude (ACE) 17 —.01 
Perceptual-Cognitive Tests 
Physiognomic Cue 14 03 
Speed of Closure —.09 —.04 
Flexibility of Closure 10 a2 
Space Orientation A7** .36* 
Stimulus-Free Problem Solving 25 24 
Attitudes (Stereotypy) —.17 —.26 
Relevant Thinking .61** = 
Instructor Ratings 
Open-Mindedness 18 —11 
Emotional Adjustment .37** 00 
Extent of Class Participation St —.06 
Quality of Class Participation 67** 12 
Potentiality for Growth 62t AR 
Overall Rating -60** 05 
Dormitory Counsellor Ratings 
Open-Mindedness 28 —.33* 
Emotional Adjustment 25 00 
Extent of Social Participation —.04 —.23 
Type of Social Participation —.07 —.18 
Overall Rating 15 —.21 


* significant at the .05 level 
** Significant at the .01 lovel 


we shall discover in the next chapter, correlate inexplicably with 
some other things as well. Let us dismiss this factor from further 
consideration for the present, taking refuge behind the usual pro- 
nouncement to the effect that additional research is required on 
this point. Of more immediate interest is the relationship between 
relevant thinking and the instructor's ratings. 

Relevant thinking is an index of the proportion of thoughts rele- 
vant to the discussion during the class hour, reported by individuals 
in subsequent stimulated recall interview sessions. It represents 
covert participation in the class process. Although such covert think- 
ing is a relevant aspect of the learning process, as revealed by the 
correlation of -+-.61 with examination performance, it is evidently 
not communicated in any way to the teacher. The instructor’s rat- 
ings of classroom participation are unrelated to the measure of rele- 
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vant thinking, although these ratings are themselves also highly cor- 
related with examination performance. 

Thus we have two independent indices of participation in class, 
both of which are highly correlated with grade averages: 


Covert participation—relevant thinking as determined by stimu- 
lated recall. 

Overt participation—extent and quality of class participation as 
determined by judgments of two or more instructors who had ob- 
served the student in small discussions for an academic year. 


These two types of participation are quite independent, and one 
cannot be adequately predicted from the other. The multiple cor- 
relation between grade averages and the combination of relevant 
thinking and quality of participation is +.86, an unusually high 
multiple correlation based on only two variables and a criterion. 

We have found that participation in the classroom, either overt 
or covert, is the major factor thus far to be discovered (with the ex- 
ception of space orientation) which is related to academic achieve- 
ment. This provides important evidence of consistency between 
process and product which should be of interest to the staff of the 
College, but we know no more now about the criterion than we did 
previously, and we are certainly in no better position to predict the 
criterion than we were before. Both of these measures depend upon 


participation in the very program for which we should like to estab- 
lish screening devices, and neither of them suggest operations by 
means of which we might assess potential performance prior to ad- 
mission to the program. 


A Hypothetical Personality Model 
for High Achievers 


The previous section has illustrated so 


sociated with the empirical approach to assessment. Further steps 
would presumably involve a search for further correlates of those 


measures which had proved useful, as well as a check upon the sta- 


me of the procedures as- 
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bility of some of these measures for other student samples in this 
same setting. Let us turn, however, to the kind of methodological 
modification of the empirical approach suggested by our previous 


deliberations. 
The fact that the only correlations of real magnitude thus far ob- 


tained have been associated with classroom participation is in itself 
of considerable interest. It would appear as if even an objective and 
impersonal criterion like that involved in performance on these 
comprehensive examinations may nevertheless involve some im- 
portant, but as yet unexamined, interpersonal factors. It is appar- 
ent that much of the student's learning is oriented towards passing 
these comprehensive examinations, which contain explicit formula- 
tions of the goals or standards of competence the student is expected 
to attain. But the student must still determine for himself the ex- 
tent to which he will work to achieve such objectives. Although he 
may believe there are many other aspects of personal growth which 
are also important, if he wishes to stay in the College and be re- 
garded as a successful student he must concern himself with the de- 
velopment of intellectual abilities and skills which are set for him 
by the faculty. The present study will demonstrate ways in which 
this emphasis on the importance of cognitive attainments is reflected 
in the thinking and learning of students, and the manner in which 
it is associated with certain of their needs or personality charac- 
teristics. 

There are other aspects of the press which characterizes this insti- 
tution that are relevant for needs determinants. The student is ex- 
pected to develop intellectual competencies over a specified set of 
subject matters. Although he may come to the College with decided 
preferences as to the kinds of subject matter in which he is inter- 
ested, or which seem significant to him for his later professional or 
vocational ambitions, he soon discovers that he is required to dem- 
onstrate competence in each one of a variety of different subject 
fields, e.g., the social sciences, the natural sciences, the humanities, 
foreign languages, mathematics, etc. This is quite different from 
the circumstances prevailing in an elective system in which the 
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student is free to select and specialize almost exclusively in those 
subject matters which are of immediate personal interest, pursuing 
them without corresponding concern for other subject matter areas. 

A third psychological characteristic of this College as a press is 
that the student’s relationships with members of the faculty are 
largely determined by intellectual activities. There is little oppor- 
tunity for him to relate to the members of the faculty on other than 
intellectual grounds. While it is not impossible for a student to de- 
velop a dependent relationship with faculty personnel, this is usu- 
ally confined to his adviser or dormitory head and only rarely with 
an instructor. 

The other students in the College also help to define the press 
for the student. They form a relatively homogeneous group insofar 
as scholastic aptitude is concerned. They are usually highly motiv- 
ated to learn the types of intellectual skills and abilities empha- 
sized in the College. Thus, extra-curricular activities, fraternities, 
and many of the other activities usually found in college, play only 
a minor role in this institution. This is only a description of the 
general trend—there is considerable variation within this pattern 
and, in a few instances, away from this pattern entirely. Undoubt- 
edly, the interpersonal relationships among the students represent 
very important aspects of the press, but these are so varied and in- 
dividualized that little can be done to study or analyze their impact 
under the conditions of the present study. 

One other aspect of the press which must be made explicit is that 
students are expected to learn from primary sources rather than 
textbooks, and much of their learning takes place in discussion 
cate where the student participates as a member of a group in at- 
tacking a relatively abstract and complex set of problems. Although 
there va: be some variation in the actual teaching procedures used, 
resülting from differences in individual temperament, training, and 
eXDEL EDIE, all of the instructors are oriented towards the use of dis- 
cussion procedures and share a common view of the teaching meth- 
ods to be employed. For this reason it is possible to assume some 
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communality of educational experience in spite of the fact that stu- 
dents are attending different discussion classes. 

Despite the fact that examination performance is the only formal 
measure of achievement used at this College, it is also apparent that 
frequent judgments about the student are made by the instructors 
and by his fellow students on the basis of his participation in the 
discussion class and as a member of the College community. Thus, 
the student is constantly confronted with problems, with models in 
the form of other students and the instructor, and with a general, 
co-operative discussion procedure in which he is expected to partici- 
pate. Consequently, many students are likely to have doubts about 
their adequacy and competence which may be relatively new to 
them, since most of the students were in the upper ten per cent of 
their classes before coming to the College and had, for the most 
part, impressions of success as scholars before they came here. On 
the other hand, as a result of their experience with the materials, 
methods, and examinations, some of these students will achieve a 
new sense of adequacy as well as considerable enthusiasm for this 
new type of learning. 

For entering freshmen (at the beginning of their 11th year at 
school) who served as subjects in this study, the psychological varia- 
bles discussed above are even further intensified by the difference 
between this set of conditions and the conditions which these stu- 
dents had met in the secondary schools attended previously. The 
adjustment of these students to a new set of learning conditions and, 
in our terms, to a new press is therefore an important factor behind 
their performance. Furthermore, many of these students have been 
separated for the first time in their lives from their homes and 
families for a lengthy period of time. With families and former 
friends no longer present, the students have the problem of becom- 
ing oriented to a situation in which there are very few parental 
substitutes and where they are expected to live and work with a new 
group of peers. Thus this new press, which is the College, may de- 
mand major reorientations in the lives of many of these students, a 
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r i Y- 
process quite likely to be related to performance on even an impe 
sonal grading system. 


A TECHNIQUE FOR GATHERING EVIDENCE 


In the analytic approach the procedure at this point would be to 
schedule a series of discussions with key members of the College 
faculty in an attempt to obtain information regarding their implisit 
criteria for student performance from which a student model might 
be derived. We shall continue to entertain the possibility that there 
is a personality model to be found which characterizes the group dt 
students who are homogeneous with respect to the objective cri- 
terion of grade average on the comprehensive examinations. Biik we 
shall use performance on the criterion itself in order to obtain ma- 
terials from which to develop an empirical model. 

In order to gain insight into the personality dynamics of an 
achievement typology in this particular setting, data obtained from 
the Activities Index were analyzed for two groups of students—a 
group of high achievers (grade averages of 3.2 and above), and an- 
other group of low achievers (grade averages of 1.8 and below). A 
summary of differences between the two groups on the Activities 
Index, by needs categories, isshown in Table 5. 

The entries in this table represent the number of items in each 
sub-scale preferred by the high and low achievers respectively, €x- 
pressed as a percentage of the total number of items in the sub- 
scale. Since there are three possible responses to each item—like, dis- 
like, or indifferent—a random reply to the items on a particular 
sub-scale would be indicated by a preference score of 33. However, 
due to the considerable variation in length for the various sub-scales 
of this early version of the Index (there have been three subsequent 


revisions), no attempt has been made to evaluate the statistical sig- 
nificance of a given gross percentage or 


pair. Instead, the validity of the interpr 


be permitted to depend upon (1) the lo 
tern which emerges, 


the difference between any 
etation which follows shall 
gical consistency of the pat- 


and (2) the Support for this particular person- 
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ality model to be found in confirmatory studies of other behavioral 
consequences deduced from the model. 


Table 5. High and Low Achiever Preferences For Major Needs Categories on 
the Activities Index, Based on the Per Cent of Maximum Possible 
Score. 
NEEDS CATEGORIES PER CENT PREFERENCE 
High Achievers Low Achievers 


Reactions to Others 


Affiliation 52 53 
Narcissism 30 30 
Coping Mechanisms 
Succorance 50 47 
Nurturance 49 52 
Dominance 40 28 
Deference 36 45 
Abasement 20 16 
Aggression 28 28 
Autonomy 34 34 
Impulse Acceptance 
Sex 29 53 
Sentience 47 48 
Exhibition 31 24 
Play 33 63 
Impulse Control 
Blamavoidance 32 46 
Energy Level 
Energy Plus 49 45 
Achievement 45 44 
Ego Ideal 31 39 
Autonomous-Homonomous Balance 
Exocathection-Extraception 45 44 
Exocathection-Intraception 49 34 
Endocathection-Extraception (Physical) 59 42 
Endocathection-Extraception (Social) ól 47 
Endocathection-Intraception 61 52 
Understanding 47 37 
Projectivity-Objectivity 7 41 
Self-Maintenance 
Harmavoidance 32 37 
Infavoidance 35 30 
Defendance 18 20 
51 48 


Counteraction 
Organization and Integration 


Order 41 42 
Conjunctivity (Disjunctivity) 42 38 
Sameness (Change) 18 24 
Impulsion (Deliberation) 34 35 

31 34 


Emotionality (Placidity) 
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The area yielding the largest differences between the two groups 
of achievers is that involving impulse acceptance. The high achiev- 
ers’ preference for play and sex interests is almost exactly at the 
chance level, whereas the low achievers indicate a liking for 63 per 
cent of the items involving play, 53 per cent of those on sex. The 
specific items on these two sub-scales which most sharply reveal 
these trends are the following: 


PLAY 
35. 
77. 
98. 


Making my work go faster by thinking of the fun I can have after it’s done. 
Spending most of my allowance on pleasure. 


Getting as much fun as | can out of life, even if it means sometimes neglecting more 
serious things. 


139. Giving up whatever I’m doing rather than miss a party or other opportunity for a 
good time. 


SEX 

110. Falling madly in love. 

136. “Going steady” with someone. 

152. Settling down and dating just one “steady.” 

193. Going to parties where couples are expected to pair off. 

It would appear that the low achievers are more free to express 
their interests in heterosexual and social activities to be considered 
appropriate for a group of sixteen-year-olds, whereas the high 
achievers are somewhat more restrained in these areas. This may 
signify an earlier maturity for the high achievers, or a retarded psy- 
chosexual development and compensatory intellectualization simi- 
lar to that found for the physics students described previously in 
Chapter 8. Evidence against the latter interpretation is offered in 
the relatively high percentage of affiliation preferences for the high 
achievers, compared with the physics subjects who were disinter- 
ested in this area. 

On the other hand, the intellectuality of the high achievers is 
clearly revealed by their interests in theoretical and abstract cog- 
nitive activities, as indicated by their choices among items classified 
under Murray’s cathective processes. The high achievement group 
is less superstitious (projectivity), expresses more interest in schol- 
arly pursuits involving the study of physical, biological, and social 
phenomena (endocathection-extraception), and is also more con- 
cerned with making these latter interests manifest in social action 
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(exocathection-intraception). The following items from the endo- 
cathection-extraception scales discriminated most sharply between 


the two groups: 


“PHYSICAL” 
31. To experiment with animals to see how different kinds of food affect their health and 


growth, 
112. Working in science or mathematics rather than art or music. 
178. To find out what causes the changes in people as they grow up. 
180, To read about how mathematics is used in developing scientific theories such as in 


explaining how the planets move around the sun. 
182. To find out why children are like their porents in certain ways, yet differ from them 


in other ways. 


“SOCIAL” 
61. To write about political or social issues, problems or events, 


Congress, revolutions, etc. 
126. To study different systems of government: the English parliamentary system, the city 


manager plan, civil service, communism, fascism, etc. 
161. To compare the problems and conditions of today with those of various times in the 


past. 
190. To find out how historical events i 


events in other countries or at other times. 
196. To study the history of present political and social problems to find out what causes 


them and what has been done about such problems in the past. 

high achievers on the comprehensive ex- 
aminations are students who have developed certain cathective 
needs centering around the understanding of abstract concepts and 
e analysis of broad problems, and a concern 
unity-centered rather than primarily 
pear serious-minded and 
t of puritanical dedi- 
articipation. 
ment 


such as bills passed by 


n one country or at one time were influenced by 


It would seem that the 


theoretical ideas, th 
With activities which are comm 
egocentric. To the adult, they would ap 
mature beyond their years, almost to the poin 
cation in their disinterest for play and hetenoseneial p 
This is further borne out by the selective pattern of achieve: 


needs differentiating the two groups. The high achievers prefer 
ure. Thus, in contrast to 


achievement of a scholarly or academic nat 
ference for such 


the low achievers, they indicate a much greater pre 
items as: 


47. Writing a fine book rather than being an important public figure. 


152 Taking examinations, 
34. Debating with friends about the relative value of various ideas or theories. 


And, conversely, a much lesser degree of liking for: 
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103. Exerting one’s self to the utmost, almost beyond the limits of one’s physical capacity, 
for something important. 


183. Achieving wealth and social prestige through success in practical affairs. 


There also appears to be a desire on the part of the high achievers 
to establish a dominant role in relation to others. Forty per cent of 
the possible responses in this category were liked by the high achiev- 
ers, as contrasted with twenty-eight per cent by the low achievers. 
Two of the items which reveal this trend most sharply are: 


6. Acting as an officer or leader in school activities. 
160. Seeing to it that other people live up to their agreements, obey rules of a game, etc. 
Closely allied to this difference in the need for dominance is the 
greater avoidance of blame and the higher interest in deferent rela- 
tions indicated by the low achievers. The following items exemplify 
the expressed preference of the low achievers for deference: 


10. Going along with a chairman's decision rather than starting a fuss. 
70. Listening to a successful person tell about his past experiences. 
105. Trying to copy the behavior of certain great men of the past. 


TESTING THE MODEL AND PREDICTING ACHIEVEMENT 


Differential response to the Activities Index by the high and low 
achievers on the comprehensive examinations seems to have pro- 
vided a means of conceptualizing a model which typifies the high 
achiever. However, as a questionnaire it is still open to distortion by 
the respondents. We do not know whether these items have the same 
significance for the subjects as they do for the assessors. And, in a 
situation where individuals may feel pressed to answer in one way 
or another, the responses may have been further biased or inac- 
curate. It seems likely that deliberate distortion has been somewhat 
minimized by the fact that most of the items are sufficiently innocu- 
ous in content so that the average student or adult does not seem 


to think of the implications of his cumulative responses, e.g., “going 
for a long walk or to a museum with one of my parents,” “ 


arguing 
with an instructor,” ‘ 


‘disregarding rules and regulations which seem 
unfair, even though I might be caught and punished,” o 


r “having 
others offer me advice.’ 


* Neverthless, we regard the instrument 


as a preliminary device in identifying typologies or in explaining 
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the performance of a particular group in terms of dynamic person- 
ality concepts. We would still look to other types of evidence in or- 
der to support the theory or explanation derived from this instru- 
ment. 

Having developed a rather crude characterization of the needs 
and personality dynamics of the two different groups of students on 
the basis of the Index, it should be possible to find support for this 
conceptualization by the collection and appropriate analysis of 
other types of evidence. Although time and resources do not permit 
a full-scale test of these hypotheses, we have attempted to secure 
some pertinent evidence on this point primarily to demonstrate the 


methodology by which it is possible in assessment to develop and 
pology. Furthermore, this illustrates one 


proceed from relatively complex and 
o simpler and more objective evi- 


test the presence of a ty 
way in which it is possible to 
subjective clinical procedures t 
dence-gathering devices. 


For the purpose of this cross-v 
was selected from the entering class five years previous to the one 


on which the model from the Activities Index was developed. 
Twenty-five of these had grade averages of B or better on the com- 
prehensive examinations which they took in the two years follow- 
ing their entrance to the program, while twenty-five had grade av- 


erages of C or lower. 


At the time of entrance these students had fi 
ch included items on recreational activities, read- 


ing, etc. Although this type of evidence has not proven very promis- 
ing in the past as an aid to prediction, these data seemed especially 
useful as a possible test of hypotheses derived from the theoretical 
model of high and low achievers. 

On the basis of the general description of the needs patterns of 
the high achievers and low achievers, one would expect that the 
former would, in general, be characterized by highly purposeful and 
intellectual activities, with only minimal interest in purely recrea- 
tional activities and with little interest in relations with age mates 


of the opposite sex. In searching the 


validation, a sample of fifty students 


lled in a biographical 


questionnaire whi 


questionnaire for items which 
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would reflect this general pattern of needs, we classified the types 
of movies, radio programs and books they claimed to have experi- 
enced and liked during the previous two-month vacation period. 
The classificatory categories were established on a priori grounds, 
and the relevant questionnaire responses assembled by assistants 
who had no information regarding the achievement status of the 
students whose responses they were classifying. 

Tables 6-8 show the results of this analysis, arranged in fourfold 


Table 6. Types of Movies Preferred by High and Low Achievers 


PER CENT PREFERENCE 


High Achievers Low Achievers 
Serious and semi-serious films, 
including documentary and foreign 75 33 
Escape films, such as musical comedies, 
light themes, fantasies, etc. 25 67 
Total 100 100 


r (tetrachoric) = +.61 


Table 7. Radio Listening Habits For High and Low Achievers 


PER CENT PREFERENCE 


High Achievers Low Achievers 
Music, drama, cultural 50 14 
All other programming, including newscasts, 
sports, comedy, quiz, and variety 50 86 
Total 100 100 


r (tetrachoric) = +.54 


Table 8. Books Read by High and Low Achievers 
PER CENT PREFERENCE 


High Achievers Low Achievers 
Academic, theoretical, cultural and classic 15 
Current events, popular and 
best sellers, adventure 38 85 
Total 100 100 


r (tetrachoric) = +.74 


matrices. The associated tetrachoric correlations, computed in ac- 
cordance with a procedure developed by Farrell and Stern (20), are 
all positive and substantial in magnitude, providing confirmatory 
evidence of the validity of the theoretical model for achievers. It is 
evident that the high achievers are purposeful and intellectual in 
the types of movies they list. Radio programs heard regularly by the 
two groups discriminate on the basis of the higher frequency of mu- 
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sic and cultural listening characterizing the high achievers. This 
pattern is further borne out in Table 8, where the high achievers 
are shown to have engaged in voluntary reading during the previous 
two months which is primarily purposeful and intellective. 

ave a picture of high achievers even five 
hasis upon contemplation, 
e Activities Index for the 


In general, then, we h 
years earlier which supports the emp 


analysis and intellectuality suggested by th 
more recent group of entrants. While these data are more suggestive 
than definitive, they do nevertheless bear out the major character- 


istics of the model for achievement obtained empirically with the 


Index. Furthermore, these data suggest some of the possibilities in 
the use of biographical data for predictive purposes, as well as for 
the development of special tests which would relate interests, recrea- 
tional activities, and hobbies in the prediction of a performance 
criterion. 

Thus, the use of the Activities Index for the purpose of obtain- 
ing an empirical differentiation between personality characteristics 
of high and low achievers has proven fruitful. In addition to sug- 
gesting other sources of screening material more highly predictive 
of achievement than the cognitive and perceptual devices in cur- 
ignificant of all were the results of a cross- 
validation based directly on items from the Activities Index itself. 
The twenty-three most discriminating items described earlier were 
employed as a key in scoring the Activities Index for a group of 100 
students entering the college the following year. The correlation 
between this score and their comprehensive examination average 
at the end of the year was +.63. It may be concluded, then, that the 
pattern of personality needs discovered as important for academic 
achievement for the original group studied is apparently stable, has 


existed in this setting for a number of years, and continues to consti- 
e of prediction and explanation of achieve- 


rent favor, perhaps most s 


tute a significant sourc 
ment for a later group of students. 

It is important to bear in mind, however, 
tionally specific. One would not expect to em 
instruments based on the biographical findings, 


that the model is situa- 
ploy these items, OT 
in other settings in 
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the absence of evidence to indicate that the achievement criterion 
has the same meaning elsewhere. An even more serious caveat, one 
which will be considered subsequently in connection with the con- 
figurational approach developed in Chapter 11, is that we must also 
be careful not to overgeneralize these findings even with regard to 
the actual population being investigated here. The achievement 
model described above is apparently appropriate for a fairly sub- 
stantial portion of students, judging from the magnitude of the 
correlations which had been obtained. However, there may well be 
other patterns of achievement which differ from this one, but which 


nevertheless relate to success and failure even within this same set- 
ting. 


Summary 


; In this chapter we have attempted to apply assessment procedures 
in order to improve the prediction of performance in terms of an 
Impersonal and objective criterion. This criterion consisted of 
grade averages based on comprehensive examinations administered 
to the students by an independent staff of examiners at the end of 
each academic year. Groups of high and low achievers, isolated em- 
pirically on the basis of their grade averages, were employed as sub- 
Jeets in this analysis. Initially the study followed along conventional 
lines, correlations being sought between a variety of quantitative 
measures presumably related to the criterion. These measures in- 
cluded a test of scholastic aptitude, an attitude test, and several per- 
captaal and perceptual-cognitive instruments. In general, the cri- 
terion could not be predicted very satisfactorily with these tests, the 
sole exception being a space test of Thurstone’s. 

As we proceeded from these tests to other sources of ev 
the students, we found two other resultants to be 
comprehensive examination achievement: ( 
participation in the classroom as judged by 


idence on 
highly related to 
1) the student’s overt 


: = the instructor, and (2) 
the student’s covert participation in the class as inferred from the 
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stimulated recall data. The combination of these two appears to ac- 
count for a substantial portion of the variance associated with final 
examination achievement. The significance of this is to emphasize 
the role of covert activity in the classroom and the necessity of plan- 
ning learning situations both in terms of overt and covert participa- 
tion. Since instructors are unable to predict covert participation, 
and in fact rarely give much consideration to the covert activity of 
students, these data highlight one of our major problems in the 
field of learning. 

Although classroom participations, both overt and covert, are 
fairly accurate predictors of examination performance, their limita- 
tion as screening devices is obvious. The most useful predictor of 
student achievement in this setting was the Activities Index. This 
instrument yielded information regarding patterns of needs which 
seemed to explain the high achievement of some students and the 
relatively low achievement of others. These data stress a seriousness 
and maturity on the part of the high achievers which seems in- 
congruous with their average age of sixteen years. They do not dif- 
fer from the low achievers, however, in their interest in relating 
themselves to others, nor are they any more aggressive or conflicted 
in their relations with authorities than the low achievers. Thus, our 
evidence does not establish a clear relation between adjustment and 
does emphasize the unusual seriousness and 
igh achievers. Further research is necessary 
ces of such high needs for intellective 


achievement, while it 
purposiveness of the h 
to establish the consequen 
activities upon these students. These data also suggest that perhaps 
one of the fundamental problems in relation to the low achievers is 
that of interesting them in intellectual activities. Their lack of in- 
terest in certain of the cathective proces: 
theoretical ideas and their relatively high interes 


should be taken as tentative hypotheses to be probed furtl 
relation of lack of achievement in the academic 
mental 


ses involving abstract, 
t in play activities 
ier. Thus, 


the possible circular 
and lack of interest in the scholarly activities may be instru 
in forcing the student into other needs, such as play and social ac- 
tivities. 
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The evidence from the Index enabled us to proceed to other 
types of confirmatory data, such as were contained in biographical 
information reported by the student, and suggested the possibility 
of devising other questionnaires and tests which would predict the 
criterion even more efficiently. The Index itself, for example, 
yielded a sub-scale of twenty-three items which correlated+-.63 with 
the criterion in a cross-validation on a later sample. Although this 
study has not been exceptionally successful in providing high pre- 
dictors of achievement, it has opened up a variety of possibilities for 
further research on the relation between personality characteristics 
and achievement, particularly in relationship to specific character- 
istics of the learning environment itself. The demonstration of in- 
terpersonal determinants involved in apparently impersonal cri- 


teria would appear to have extensive methodological as well as 
theoretical implications. 
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CHAPTER 10 


A Synthetic Study 
of College Freshmen’ 


THE STUDIES IN THE PRECEDING TWO CHAPTERS HAVE 
indicated that a systematic comparison of subjects who have al- 
ready been evaluated in terms of their actual performance in a 
Specified situation can yield evidence regarding the criterion from 
Which screening standards for new candidates may be derived. It 
is apparently possible to substitute this empirical approach for the 
analytic procedures described earlier which depended upon par- 
ticipant observation and functional analysis of the criterion situa- 
tion. 

Although the empirical study of college freshmen employed a 
variety of measuring instruments, the successful differentiation be- 
tween the criterion groups was accomplished largely on the basis 
or Psychodynamic and interpersonal factors from which a person- 
ality model relevant for optimal performance was finally developed. 
The more conventional measures of scholastic aptitude and of 
cognitive or perceptual skills proved far less useful in predicting 
even an impersonal criterion such as achievement on objective 
examinations than did the psychodynamic model. 

As in the case of the analytic approach, the next stage of develop- 


è Pielii 
Preliminary reports of this study have been presented elsewhere (26, 63, 64, 66). 
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ment in the empirical method would involve the construction of 
special instruments designed to identify individuals who are repre- 
sentative of the hypothetical model of an optimal performer. The 
analytic studies of prospective ministers and teachers, for example, 
rested upon the conceptualization of models which had been in- 
ferred from a direct analysis of the conditions under which per- 
formance was to be obtained. An even more attenuated approach 
is conceivable, however, which originates with a preconceived 
model developed by the assessor independently of any direct con- 
tact with the situation itself or with current performers. It is based 
on certain a priori assumptions regarding personality dynamics, 
and seeks to synthesize purely hypothetical personality syndromes 
which will have predictable consequences for interaction in a speci- 
fied situation. 

The use of synthetic models for assessment purposes has occurred 
most frequently in conjunction with an essentially clinical ap- 
proach. Assessors trained in the use of projective instruments and 
interviewing techniques have typically attempted to arrive at some 
global prediction of probable success based upon information de- 
rived from such data. The criterion for the prediction is based, 
however, not upon an explicitly developed model of the optimal 
performer tied systematically to the expectations and demands of 


the criterion situation, but rather upon implicit and frequently 


unspecified assumptions regarding performance in the abstract. 
The present study attem 


pts to demonstrate that a synthetic 
model can be used effectively for prediction, is susceptible to quan- 
titative and objective measurement, and constitutes an economical 


alternative to the assessment methodologies thus far discussed. Its 
effectiveness depends, however, upon the degree to which the 
synthetic model can be specifically related to the performance situa- 
tion, as well as upon the actual presence of persons among those 
being screened who can be typified in terms of the synthetic model. 
This latter qualification constitutes its major limitation. Since it in- 
volves an abstract model with consequences for performance ar- 


rived at deductively, only the actual testing itself will reveal 
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whether persons corresponding to the model are actually to be 
found in the situation. 


A Synthetic Model of the Stereopath 


In reviewing the characteristics of the College in which this study 
was undertaken, it seemed clear that at least one of the synthetic 
models which has appeared consistently in psychological and psy- 
choanalytic literature had distinct implications for interaction and 
performance in the College program described in the previous 
chapter. The model in question has been referred to at one time or 
another as the sadomasochistic or authoritarian character, and has 
been developed in detail by Horkheimer (29), Fromm (24, 25), 
Frenkel-Brunswik and Sanford (22), and Adorno et al. (1). Closely 
related patterns and variants have also been described by Weber 
(79), Tawney (69), Ranulf (48), Riesman (50), Chapman (11), and 
Dodds (18), who have arrived at their conclusions from a somewhat 
broader sociological, historical, or philosophical base. 

Essentially the concern here is with a hypothetical individual 
who may be characterized in terms of depersonalized and codified 
social relationships, pervasive acceptance of authority as absolute, 
inhibition and denial of impulses, and rigid orderliness and 
conformity in behavior. He is assumed to have had a stern, discipli- 
nary upbringing from at least one parent. Fearful of this authori- 
tarian figure, the child submits overtly, exaggerating the unques- 
tioned excellence of this parent and repressing the tremendous 
hostility which cannot be directly expressed in consciousness. One 
possible exception to the complete displacement of this counter- 
aggression may be discerned, however: the parent's dictates could 
be disobeyed under the guise of being faithful to superior com- 
mands, e.g., religion or the state. In this case, however, the same 
pattern of submission to the superior authority ensues; the parent 
has simply been relegated to a lower hierarchical position. In either 
event, guilt for the untenable hostile impulses results. Since little 
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introspection is indulged, aggressive impulses are displaced and 
frequently turned back upon the self in the form of paranoid per- 
secutory fears. Identification with the aggressor may occur, and 
enjoyment of personal discomfort undergone as penance for im- 
moral or non-deferent behavior. 


Table 9. The S Syndrome 


1. Reactions to Others i 
Depersonalization of relationships. Perception of authority figures as omnipotent, 
threatening, and impregnable. 

2. Coping Mechanisms 


Submission to authority. Overwhelming unconscious hostility, displaced externally. 
Aggression expressed extrapunitively in attempted dominance and control. 
3. Impulse Acceptance 


Inhibition and denial of id impulses. Depersonalized sexuality. 
4. Impulse Control 


Strong, punitive superego structure, not necessarily internalized. Anxiety and guilt 
associated with unconscious hostility. Control of unacceptable impulses in order to 
avoid criticism or disapproval of parent or parent-: 
in impulse-ridden physical outbursts. Such explosions 
anxiety and guilt. 

5. Energy Level 


surrogate is incomplete, resulting 
are non-cathartic, only increasing 


Ineffectual liberation of effective tension and continual free-floating anxiety drains off 


energy otherwise available for goal-directed activity. Compensated for by autistic 
thinking in goal-behavior and fantasied achievement. 
6. Autonomous-Homonomous Balance 


Predominantly exocathective-extraceptive: manipulating things and people as external 

objects through practical, concrete physical action. Conformity and adaptation to 

reality as given for more-or-less immediately tangible ends, emphasizing money and 

Property. Counter-cathective rejection of sensuality, introsp 

verbal-emotional-artistic expressiveness. 

anthropomorphism, mysticism, superstition. 
7. Self-maintenance 


ection, intraception, and 
Egocentric (infantile) perception: animism, 


Repression, inhibition, Projection, paranoia, 

negative aspects of self. Conce 
8. Organization and Integration 

Sphincter morality, emphasi 


escapism, masochism, sadism. Denial of 
rn with physical symptoms, appearance. 


and conflicted due to uncontrolled 
+ inaccessible to new e: 
from tradition. Rigid and compulsive. 


Table 9 summarizes the major personality parameters for such 
a model, which we shall refer to henceforth as the Stereotypy or S 
Syndrome. We have postulated that configurations of this order 


are fundamental in determining the many aspects of an individual’s 
total behavior which arise from interactions with 


specific environ- 
ments. Thus, 


individuals similar in personality dynamics may 
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also be expected to engage in similar types of interpersonal experi- 
ences, share common ideological, attitudinal, and value orienta- 
tions, exhibit particular approaches to problem-solving and con- 
cept formation, etc. 

In the present case it seemed likely that marked differences be- 
tween the hypothetical Stereopath and other types of persons would 
be found in connection with academic performance in the particu- 
lar setting being studied. Inasmuch as representatives of the S syn- 
drome might be expected to encounter considerable difficulty in 
tasks involving ambiguity, abstraction, spontaneity, and departure 
from conventional standards, it could be predicted that such per- 
sons would encounter particular difficulties in such areas of a gen- 
eral education program as the Humanities and the Social Sciences. 
It is in these areas of the College program in question where con- 
siderable emphasis is placed upon abstract analysis, relativity of val- 
ues and judgment rather than fixed standards, and an intraceptive 
rather than an impersonal orientation. The impairment of per- 
formance for the Stereopath in these areas was also expected to 
follow from the explicit conflict between the ideological and value 
orientations of such persons and the essential orientation of the 
College itself. This conflict is associated not only with differences 
in socio-political values, but even with regard to the basic role as- 
signed to these areas. For the practical-minded S, the Humanities 
and Social Sciences in themselves would appear to be irrelevant 
and non-essential elements of a college education. 

These same considerations apply as well to the more general 
response of the S to the program at this institution. The S may be 
expected to view the purpose of higher education as serving pri- 
marily to train the student in the development of specific skills 
which will equip him to enter into specifically delineated profes- 
sional occupations. The seeming diffuseness and lack of specificity 
of a general education program from the S's point of view should 
contribute to feelings of conflict and dissatisfaction eventuating 
in poor grades, emotional disturbance, and/or withdrawal from 
the College. The lack of formality and hierarchical organization in 
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the discussion classes themselves, described in the previous chapter, 
would also contribute further to this conflict between the S and the 
College. : 

A final area of differentiation for the S, in contrast with other 
types of students in this institution, can be predicted with regard 
to the ultimate vocations for which the S’s are preparing them- 
selves. The emphasis upon practical activity, tangible recognition 
of achievement, and depersonalization of relationships, suggests 
that the S is more likely to be found among those entering such 
careers as medicine, law, business, engineering, etc., and less likely 


to be among those preparing for academic work or for the expres- 
sive arts. 


A Synthetic Model 
of the Non-Stereopath 


In the process of elaborating upon relationships between S-type 
individuals and this particular College milieu which would be of 
significance for academic performance, it soon became apparent 
that another model was being implicitly formulated by the asses- 
sors. This second model apparently represented a conceptualization 
of a syndrome nearly polar to that characterizing the S. The Non- 
Stereopath, or N, seemed to be represented by highly personalized 
and individualized social relationships, pervasive rejection of 
authority figures, spontaneous and acceptant impulse life, and non- 
conforming flexibility in behavior. This type is seen as the product 
of homes where parents tend to be permissive, nurturant, or even 
overprotective of their youngsters. Self-importance is established 
early, at the expense of parental respects or thorough going sub- 
mission. Limitations and deprivations come from the extra-familial 
environment, rather than from the 
bringing may result in positive feeli 
parents or, 


parents. Reaction to this up- 
ng and identification with the 


in the case of excessive parental concern perceived by 


the child as coercive possession, in seething resentment. In any 
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event anxiety is focal and specific, and is readily counteracted. High 
value is placed upon interpersonal relations, intellectual interests, 
self-expression in the arts, enjoyment of sentient experiences, es- 
thetic cultivation, and interest in social affairs. This group is likely 
to champion the rights of the underprivileged and the discrimi- 
nated, turning their own strong succorant needs into nurturant 
ones. They are introspective, conscious of themselves and their emo- 
tional and physical states. 


Table 10. The N Syndrome 


1. Reactions to Others 
Highly personalized relationships. Perception of authority figures realistically, frequently 
as overprotective or overpossessive. 

2. Coping Mechanisms 
Identification with cathected objects. Conscious rebellion and overt rejection of negative 
or ambivalent cathexes. Aggression expressed freely and directly in attempt to main- 
tain inviolacy, autonomy, and independence. Generally characterized by maintenance 
of good contact and rapport with others. 

3. Impulse Acceptance 
Acceptant of id impulses. Capable of direct sentient and sexual representations, as well 
as their sublimations. 

4. Impulse Control 
Balanced ego-id-superego demands. Anxiety associated with conscious hostility more 
focussed, more readily verbalized and dissipated. Internalized superego. Conflict con- 
scious and verbalized. Capable of responsibility and emotional maturity. 

5. Energy Level 
Capable of sustained effort for remote goals. 

6. Autonomous-Homonomous Balance 
Predominantly other-directed, placing great emphasis on interpersonal relationships. 
Identification with “underdog,” and capacity for dramatic, idealistic social action. Sen- 
suous, introspective, intraceptive. Verbal-emotional-artistic sublimations. 

7. Self-Maintenance 
Counteraction. Exhibitionism and self-dramatization. Capacity for realistic self-ap- 
praisal, introspection. 

8. Organization and Integration 
Behavior plastic and labile. Capacity for spontaneity, impulsiveness. Mobile and in- 
tense emotional responsiveness. Flexible, adaptable to changing circumstances. 


The antipodal nature of the N syndrome in relation to the 
Stereopath is suggested by the summary of characteristics pre- 
sented in Table 10. This is the description of the individual whose 
performance seemed most likely to be outstanding in this particu- 
lar academic setting. 

The extensive polarity between N’s and S’s which is revealed 
by a systematic comparison of Tables 9 and 10 provides an interest- 
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ing alternative in the development of an assessment procedure 
which can be used for the purposes of identifying representatives 
of these two syndromes among applicants for admission to the Col- 
lege. Although projective tests would seem to provide the only 
way of obtaining evidence regarding the total configurations which 
define the N and S, it is clearly impracticable to administer and 
analyze such tests as the Rorschach or TAT to an entering class 
of 500 students in order to isolate those particular persons for 
whom the hypotheses regarding performance indicated previously 
could be expected to apply. 

However, in the same sense that the predicted differential in per- 
formance in the Humanities might be considered a peripheral de- 
rivation or consequence of the personality model, so too do other 
areas of differences exist which provide an indirect but precise 
diagnostic discrimination between th 
though there are a wide variety of w 
of representatives of a personality ty 
work of Adorno and his associates ( 


ese two types of persons. Al- 
ays in which the identification 


pology might be attempted, the 
1) has suggested that an ideologi- 
cal inventory may prove most effective in this particular case. The 
initial development of an instrument for this purpose was under- 
taken in conjunction with the activities of the Attitudes Sub-Com- 
mittee of the Co-operative Study of Evaluation in C 


seneral Educa- 
tion of the American Council on Education (19), 


The Inventory of Beliefs 


The formal structure for this diagnostic instrument w. 
veloped in terms of the dimensions summarized in T 
levels of interaction, regarding the indiv 
and intellectual abstractions, social groups and identifications, 
interpersonal relations, and the self, were specified for which diag- 
nostic particulars could be adduced which were peculiar to the S 
syndrome and antithetical to the N. The particular items which 
were used for the purpose of implementing this formal structure in 


as de- 
able 11. Four 
idual’s relations to ideas 
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a testing format were selected from over three thousand clichés, 
pseudo-rational statements, and inappropriate generalizations 


submitted by faculty members from institutions offering general 


education courses. From this pool, which included a surprising 


Table 11. A Conceptual Framework for the Inventory of Beliefs* 


Level 


1. Ideas and institu- 
tions (ideocen- 
trism) 


2. Social groups 
(ethnocentrism) 


3. Individuals, inter- 
personal relations 
(sociocentrism) 


4. Self 
(egocentrism) 


Content 
1.1 Philosophy 
1.2 Religion 


1.3 Arts 
1.4 Sciences 


1.5 Politics, economics 


2.1 Out-groups (Ne- 


groes, Jews, other 
minorities, foreign- 
ers) 

2.2 In-groups 


(Chauvinism) 


3.1 
3.2 
3.3 
3.4 
3.5 


Family (parents) 
School (teachers) 
Church (ministers) 
State (public officials) 
Business and con- 
sumer relations 
(tradesmen) 
Friends, peers, 
lings 
Self-concept, self- 
evaluation 


3.6 sib- 


4) 


2.12 


2.21 


3.17 


to 


3.16 


Variables or Dimensions 


Materialistic, manipulative, pow- 
er, cynical 

Mystical, ritualistic, nonpersonal 
Romantic, antisensual, anti-intel- 
lectual, anticultural 
Application, limitation, 
tional è 
Dependence, adherence to out- 
moded ideas, distrust, denial of 
conflicts 

Personal characteristics (offensive, 
immature, threatening, intrusive, 
seclusive) 

Solutions (pseudodemocratic: seg- 
regation, limited participation; 
antidemocratic: elimination, exclu- 
sion; insoluble: fatalism, despair, 
cynicism 

Uncritical acceptance of values, 
exclusive pride in memberships, 
blindness to or dismissal of short- 
comings 

Irrational acceptance of external 
authority, unwillingness to assume 
personal responsibility, shift of re- 
sponsibility to others, blaming 
others for failure (extra-punitive), 
resistance to departure from tradi- 
tion, depersonalization of rela- 
tionships, sentimentality (“mom- 
ism,” etc.) 

Perception of external world as 
threatening, as manipulable; sub- 
mission and aggression, rigidity 
and compulsion, superstition and 
stereotypy, destructiveness and 
cynicism; free-floating anxiety, 
preoccupation with health and 
sex; over-spiritualization, denial, 
fear, and depersonalization of 
sexuality 


antira- 


*Reproduced from General Education: Explorations in Evaluation, by P. L. Dressel and L. B. 


ayhew, Washington: American Coun: 


I on Education, 1954, pp. 217-218. 
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number of almost word-for-word duplications coming from widely 
separated geographical sources, a set of items was obtained which 
was judged to be appropriate for the various levels, contents, and di 
mensions given in Table 11. Examples of the kinds of items in- 
cluded in this original form are: 


The scientist that really counts is the one w 
practical use. 


Now that America is the leading country in the world 
natural that other countries should try to be like us. 

The many different kinds of 
teachers to make a lot of rules an 
smoothly. 


A person often has to get mad in order to push others into action. 


ho turns theories into 
, it’s only 


children in school these days force 
d regulations so that things will run 


It will be noted that acceptance of these items by the respondent 
is presumably characteristic of the Stereopath. The Non-Stereopath 
would be expected to reject them. The study to be described here 
was based upon two successive groups of entrants to the College. 
In the first, 100 such S-type items were assembled into an inventory 
to which the respondent could indicate one of four choices, involv- 
ing two degrees of agreement and two of disagreement. Subjects 
who were more than one sigma beyond the mean in the direction of 


total acceptance were identified as Stereopaths; those at the other 
end of the distribution were considered N 


This parallels closely the scales dev 
associates (1) 


on-Stereopaths. 


eloped by Adorno and his 
» and in fact the S-syndrome was developed to a large 
extent from their characterization of the authoritarian person- 


ality. However, the items employed in the Inventory appear to 


sample a much broader range of attitudes than those covered in 
the E (Ethnocentrism), F (Fascism), and PEC (Political-Economic 
Conservatism) scales developed by that group. The effect of this 
wider coverage appears to reduce the apparent differences between 
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tionships among their three scales. Apparently the Inventory comes 
close to representing the area of common overlap between the 
three California scales, inasmuch as it correlates no higher with 
any one of the three sub-scales than does that particular sub-scale 
itself correlate with the remaining two. 

Asa result of the first year’s study it became apparent that people 
identified on the basis of their acceptance of these items were highly 
homogeneous. Their opposite numbers, however, seemed to in- 
clude persons reflecting the characteristics of the N-syndrome as 
well as a second group who also rejected the S-type statements but 
who otherwise differed from the N-syndrome. It proved possible 
to develop a third synthetic model for this group, which was 
labeled as the R-syndrome (Rational). This syndrome appeared to 
be independent of both the N’s and S's, characterizing individuals 
whose social relationships are distant and impersonal, cathecting 
ideas rather than persons. As children they experienced parental 
fallibility. Possibly the parents were dead, absent, or simply indif- 
ferent. In any event, no integrated relationship would seem to have 
been established between the superego and the ego. The rules by 
which one ought to live have not been successfully juxtaposed with 
perceived reality, leading to the divorcing of private ethics from 
social interaction. Occurrences seem unpredictable and inexorable. 
The child has perceived both himself and his parents to be at the 
mercy of external forces. The unpredictability and strength of this 
alien, external control precludes active resistance, resulting in 
passivity, resignation, and futility. In detached fashion the child 
is left to speculate on the inevitability and insignificance of exist- 
ence, substituting intellectualization for interaction. Anxiety is 
therefore diffuse, and the self seen as puny and weak. As adults 
there would seem to be a certain laxness in the egos of representa- 
tives of this type, allowing them to experience emotions and im- 
pulses without attempting to control them, but simply resigning 
passively. Thinking likewise may be lax, although the channelling 
of energy into intellectual activity in some cases can be highly 
productive. This pattern is summarized in Table 12, and has 
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Table 12. The R Syndrome 


1. Reactions to Others i ; i 
Little emotional involvement in personal relationships. Perception of authority figures 
as distant, vulnerable and fallible. 

2. Coping Mechanisms n - 
Passivity, autonomous detachment. Hostility expressed verbally, in cynicism and criti- 
cism. 

3. Impulse Acceptance 


Passive resignation to id impulses, frequently sublimated following conscious inhibition. 
4. Impulse Control 


Weak ego-id resolution. Highly intellectualized control. Diffuse anxiety. 
5. Energy Level 
Moderate to strong, directed chiefly toward abstract pursuits, 
in content. 
6. Autonomous-Homonomous Balance 
Predominantly inner-directed, placing major stress on endocathective processes. This 
may be oriented extraceptively, taking the form of speculative abstraction and dis- 
cussion about external objects, events and systems, emphasizing data collection, experi- 
mentation, and inductive reasoning. Alternatively the orientation may be in terms of 
an intraceptive preoccupation with private experience; psychological, spiritual, esthetic, 
or metaphysical truth; introspective and deductive reasoning. The major emphasis in 


either event is on disinterested intellectualization: analysis, abstraction, and synthesis 
for the sake of conceptualization rather than action. 
7. Self-Maintenance 


Avoids situations which might result in frustration or failure, or submits with resigna- 


tion and passivity. Blows to self-esteem parried with rationalization of futility of op- 
position. Open conflict concerning adequacy. 
8. Organization and integration 


sometimes impractical 


Behavior alternately purposeful and integrated, uncoordinated and diffuse. Restrained 
emotional responsiveness, affect frequently flattened. 


properties similar in many respects to the characterization of the 
physicists which was developed empirically in Chapter 8. 


FORMS S AND T 
As a result of the emergence of the R-syndrome, the previous 


form of the Inventory consistin 


g wholly of S-type generalizations 
(Form S) 


was subsequently modified by incorporating a new block 
of items with contents representing the inverse of the S statements. 
One-half of the items of the new Form T were therefore identical 


with the earlier form, while the other half consisted of statements 


which were presumed to be acceptable to the N’s alone, such as: 


It is more important for a book or m 
pleasant. 


Allowing more immigrants of all kinds in 
our culture. 


ovie to be realistic than to be 


to this country will improve 
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More playgrounds and fewer strict fathers would eliminate juvenile 
delinquency. 
The welfare of others is more important than one’s own self-interests. 


The S subjects are identified then by their acceptance of S-type 
items and their rejection of the N-type opposites. The reversal of 
this pattern serves as the basis for isolating N subjects, while R's 
are identified by their persistent rejection of both kinds of generali- 
zations. Thus, the N’s and S’s are at the opposite ends of a contin- 
uum which is orthogonal to the R’s. Although the S's are pre- 
sumably equivalent to the California group’s authoritarians, their 
equalitarians are at the intercept where neither N’s nor R’s can 
be differentiated from one another. Form T of the Inventory, by 
extending the anti-authoritarian direction of the California scales 
in order to include propositions which the N’s will accept but 
which are no more acceptable to the R’s than the other, authori- 
tarian half of the items, succeeds in differentiating these two per- 
sonality types from one another. 

This later form of the Inventory, Form T, was the one employed 
with the second group of entrants who served as subjects in the 
study which follows. Although comparative data will be given for 
the R’s identified in this second group (but not for the first, since 
Form S is not adequate for making such a discrimination), it should 
be noted that no specific predictions regarding performance were 
made regarding representatives of the R-syndrome. The model was 
considered to be valid, and evidence supporting this point will be 
presented later for all three syndromes, but no differential conse- 
quences for performance in this situation were anticipated for the 
R's. This is an instance of a synthetic model which has no signifi- 
cant implications for interaction in the criterion situation, Un- 
like N’s, whose performance was expected to prove exceptionally 
adequate as a result of the correspondence between their needs and 
the College press, or the S's for whom the opposite prediction could 
be made, the R’s were not thought likely as a group to yield other 
than an average and undifferentiable performance record. The 
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sole reason for isolating them here is in order to refine further the 
N group with which they had previously been confounded. 


INVENTORY RELIABILITY 

Over forty reliability studies of the several existing versions of 
the Inventory have been made, with samples ranging in size from 9 
to 636, the majority involving groups of more than 100 subjects. 
These have yielded reliability coefficients ranging from +.68 to 
+.95, with a median value of +.86. Variation in the magnitude of 
these coefficients appears to be independent of the type of reliability 
computed; similar results have been obtained wth Kuder-Richard- 
son, test-retest, split-half, and parallel forms procedures. 

This variation appears to be a function, however, of the institu- 
tion from which the subjects were drawn, some groups providing 
much less dispersion among the three typologies th 
an attendant drop in statistical reliability. An indi 
tion in the numbers of representatives of each type 


different locations, as obtained fr 
Inventory, 


an others, with 
cation of varia- 
encountered in 


om testing with Form T of the 
is provided in Table 13, There are several features in 


Table 13. Per Cent Representation of $, N, a 


tions of Selected Institutions, 
liefs (Form T) 


PER CENT OF TOTAL 
INSTITUTION 


nd R Types in the Total Popula- 
as Identified by the Inventory of Be- 


Total No, 
sS N R Unclassified of Cases 
High School 29 o 14 57 210 
Southern College 12 4 24 60 73 
Military Academy 26 2 35 63 299 
Northern College 8 18 44 70 636 
Group Dynamicists 2 26 60 12 297 
Liberal Seminary 4 45 50 1 


29 


example, is not likely to prove compatible to N's. Th 


in themselves suggestiv 
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sonality, performance, and environment which has been advanced 
in this work. It would also appear that R’s are more likely to be 
found in situations where N’s exist and but few S's, although the 
relationship is not quite as marked as for the N’s. 

Finally, it should be noted that the number of cases identified 
in each institution as representative of one or another of the three 
typologies varies considerably. For four of the six groups reported 
here, however, over half the population remains unclassified. The 
Inventory is analogous to a diagnostic test in clinical medicine 
which is specific to a given pathogenic process. Situational pre- 
dictions in the present study apply only to the N’s and S's in this 
particular milieu, and not to the large remainder who are un- 
classified. This is similar to the chest X-ray, for example, which is 
limited to identifying those cases in the total population with a 
lung pathology but which contributes nothing regarding the many 
persons who are negative on this particular test. 


The Stereotypy Study 


This lengthy introduction has been necessary in order to ac- 
quaint the reader with the details of several synthetic models which 
are likely to be unfamiliar to many, and to indicate the nature of 
the instrument which will be used for the identification of persons 
who are representative of these models. The present study was 
undertaken with two successive groups of college freshmen matricu- 
lating at the same institution, the first consisting of 514 students 
and the second of 498. It was expected that students identified as 
S's and N's by their scores on the Inventory would be readily dis- 
tinguishable from one another, and from the remainder of the 
entering class, in a wide variety of ways. 

Some of these specific predictions, involving differential achieve- 
ment in the Humanities and Social Sciences, emotional adjustment 
to the College, and vocational preferences, have already been dis- 
cussed. Not all of the characteristics differentiating these two groups 
which are reported in the pages which follow were anticipated by 
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Means for Selected “Schools Particl- 
poting in the Cooperative Study: 

College A 
B (Current Sample) 


FREQUENCY 


o 10 20 30 40 50 60 70 60 90 100 uO 120 130 140 150 
STEREOPATHS RAW SCORE-FORM S ONS TER EATS: 
(S's) N's 


FIGURE 6 


Distribution of Inventory of Belief scores (Form S) for, 514 college entrants, as 
compared with mean scores for nine other selected schools 


us, to be sure. However, in all instances these additional findings 
are entirely consistent with the conceptualized model, and in no 
case require any ad hoc interpretation. 

Figure 6 shows the distribution of scores obtained on the Inven- 
tory for the first group of entrants studied. The shaded areas indi- 
cate the subjects one sigma above and below the mean who were 
identified as N’s and S's respectively (Form S, used with this first 
group of entrants, does not differentiate between N’s and R’s). 
Data obtained through the Co-operative Study of Evaluation in 
General Education of the American Council on Education is in- 
dicated in the upper portion of the figure. These data suggest that 
the percentage of S's at other colleges and universities tends to be 
larger than the sixteen per cent isolated in this colle 


ge, and the 
percentage of N's generally smaller. 


INTELLIGENCE 


Studies of relationships between various social attitudes and 
common measures of intelligence over the past several decades 
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have consistently shown low but positive correlations. Insofar as 
the Inventory is largely ideological in content, it should have a 
similar relationship. Since predictions for the psychological types 
identified by the Inventory are to be made with regard to academic 
performance, which is patently dependent to some degree on sheer 
intellectual capacity, we shall consider first the extent to which 
intelligence and the Inventory of Beliefs are confounded. 

The correlation between the ACE Psychological Examination 
and the Inventory of Beliefs for the first group of 514 entrants 
studied is +.25, with the N’s assigned to the upper end of the score 
continuum on both tests. Although this value is statistically signifi- 
cant, it should be noted that this indicates only six per cent of the 
variance in the Inventory to be associated with variance in intelli- 
gence as measured by the ACE. 

We are more concerned with the two selected groups of S’s and 
N's, indicated by the shaded areas in Figure 6, than with the total 
distribution. These two groups, accounting for thirty-two per cent 
of the total entering class, consist of eighty-one students each. The 
mean ACE scores for the Stereopaths and Non-Stereopaths are 
20.8 and 23.5 respectively, in terms of the derived score scale em- 
ployed by the College. This difference is significant beyond the .001 
level; furthermore, the mean for the entire class is 22.1, indicating 
the Non-Stereopaths to be above average in intelligence as con- 
trasted with the total class, whereas the Stereopaths are below 
average. Corresponding to this significant difference in means be- 
tween the two selected groups is the significant correlation of +.33 
which obtains for them between ACE and Inventory. It should be 
noted, however, that this value of +.33, indicating the degree of 
relationship, is associated with a coefficient of alienation of .94, 
indicating the degree of independence between the two tests. Only 
eleven per cent of the variance in the Inventory is associated with 
variance in ACE; eighty-nine per cent of the variance remains un- 
accounted for. Thus we cannot conclude that intelligence accounts 
for any considerable part of Inventory performance. 

However, in order to rule out any variations in academic per- 
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formance which might be attributable to this difference in intelli- 
gence, the two groups of eighty-one students were matched on ACE 
scores. This matching resulted in a reduction from sightyons to 
sixty-one cases in each group, with mean scores of 22.4 and sigmas 
of 3.4. These values are almost identical with those for the total 
entering class, so that we have not only equated the Stereopaths and 
Non-Stereopaths with respect to intelligence, but have also selected 
those members of both groups who are equivalent to the remainder 
of their classmates on this variable. 
A similar procedure was followed with the second entering class 
studied. Despite the continued low correlation with intelligence, 
representatives of the three syndromes as differentiated by Form T 


were also equated on ACE, leaving forty-eight cases for analysis in 
each group. 


PLACEMENT TESTS AND INITIAL MEASURES OF ACHIEVEMENT 

Upon admission to the College, all students participate in a 
series of placement examinations covering each of the major areas 
of the College program. Differences in performance on these exami- 
nations for the N’s, R’s and S’s, representing differences in the skills 
and abilities which students so identified possess prior to matricu- 
lation in the College, are shown in Table 14. This table indicates 
rather clearly that extremely significant differences exist between 


the N’s and S's in the Humanities, Social Sciences, English and 
Language 1. This latter area refers, 


but to the analysis of language as 
remembered that differential performance in Humanities and 
Social Sciences had been predicted; although the results in English 
and Language 1 had not been anticipated, they are entirely in ac- 
cord with inferences concerning lack of verbal facility, flexibility 
and skill in analysis which can be deduced from the model of the 
syndrome presented earlier. It is further worth noting that the Non- 
Stereopaths are consistently above average in these four areas in 


relation to the total group of entrants on which the scale of per- 


centile equivalents is based, despite the fact that matching has 


not to the foreign languages, 
a symbolic system. It will be 
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Table 14. Relative Performance on Entrance and Placement Examinations, for 
Selected Students Matched on ACE 


Median Score Expressed as a Percentile Rank in 


Placement the Total Class Distribution 
Examination FORM S SUB-GROUPS* FORM T SUB-GROUPS® 

N sS po N R S po 

Social Science 71 46 .001 67 50 38 .01 
History 73 46 .05 75 55 46 — 
Understanding 70 34 -001 73 61 30 .001 
Reading Analysis 67 42 01 66 60 34 001 
Humanities 84 57 -001 62 56 39 01 
Art 90 75 01 67 47 38 01 
Music 85 54 001 64 57 38 — 
Literature I 79 46 .001 57 47 38 — 
Literature Il 82 55 01 61 59 23 01 
English 75 52 -001 65 64 37 .05 
Essay 74 45 .05 59 62 39 01 
Reading 87 65 01 83 69 56 .001 
Writing 81 62 01 74 72 44 05 
Language | 73 46 -001 66 56 45 — 
ACE Total 74 74 - 71 71 71 — 
Linguistic 68 62 = 67 60 57 — 
Quantitative 54 61 — 52 55 66 = 
Foreign Language 61 38 = 66 52 49 =< 
Reading 63 52 _— 65 56 56 — 
Biological Science 58 49 — 65 57 50 — 
Understanding 66 60 — 66 57 67 — 
Reading Analysis 62 48 — 64 58 42 — 
Physical Science 43 45 — 56 59 48 _ 
Chemistry 47 48 05 58 52 53 — 
Mechanics-Astronomy 48 37 — 48 53 55 — 
Reading Analysis 41 Al — 56 65 Al — 
Mathematics 59 46 _— 50 47 49 — 
Elementary Algebra 65 59 — 65 50 62 — 
Mathematical Aptitude 66 49 — 60 53 35 .05 
Advanced Math 63 38 — 62 53 57 — 


a61 cases in each sub-group. 

» 48 cases in each sub-group. 
or Probabilities obtained from chi-square tests of independence based on original frequency dis- 
ributions. 


minimized effects attributable to differences in intelligence. The 
Stereopaths, on the other hand, seem little different from the aver- 
age entering student in these areas; in several instances they are 
markedly below average. 

The lower portion of Table 14 indicates only random variation 
between the two groups in the Biological Sciences, Physical 
Sciences, and Mathematics. In these areas both Stereopaths and 
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Non-Stereopaths approximate the performance of their classmates. 
Although it would be unreasonable to characterize these areas as 
not requiring detached analysis or abstraction, it seems equally 
legitimate to consider these skills to be of somewhat less importance 
in these areas at the lower levels of the College than in the case of 


the Humanities or Social Sciences. The areas presented at the top 


of Table 14 require such skills, as presented in this program of 


general education. The areas at the bottom, on the other hand, are 
far more concrete and factual at this educational level. The orienta- 


tion of the College, as reflected in the placement examinations, re- 
quires that the student be able to disreg: 


ard fixed frames of refer- 
ence which may prev. 


ail for the moment in some part of our culture 


and consider alternative sets of values. It is the student who must 


judge, but only after he has become competent to make a choice 
through awareness of alternatives, Thus a premium is placed upon 
capacity for detachment, for delaying resolution or closure, and 
for tolerating ambiguous relativities rather than demanding struc- 
tural absolutes. Such requirements are maximized in the Humani- 
ties and the Social Sciences, but are of lesser importance in the 
Natural Sciences and Mathematics. In these latter areas there is no 
cleavage in values to be reconciled by the student. The subject 
matter of the Natural Sciences at this level, for example, is divorced 


from value systems on the one hand and highly structured and 
concrete on the other. 


LEARNING OUTCOMES 


In the absence of resources which might have made it possible 
to observe and record the classroom and campus experiences and 
behaviors of these groups of selected students, 
limited to sources of relevant data which wer 
tinely by the College and were therefore readi 
are for the most part represented by the cont 
folders in the Office of the Dean of Students, 
tion regarding academic participation durin 


comments on progress, special problems, 


we are necessarily 
€ maintained rou- 
ly available. These 
ents of the student 
containing informa- 
g the year, advisers’ 
general adjustment, etc., 
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and the performance of the students on the comprehensive exami- 
nations administered at the end of each academic year. 

For a limited number of S’s and N’s who were participants in the 
block registration groups described in Chapter 9, data with respect 
to covert classroom behavior as revealed by the method of stimu- 
lated recall was available. Since there were only twenty subjects so 
studied, no claim of significance or generality is made for these 
data; the trends suggested, however, are in accord with general 
expectation and are of considerable intrinsic interest. 

Tetrachoric correlations computed between the Inventory and 
various components of Relevant Thinking (see Chapter 9) for 
these twenty cases range from —.72 to +.84. Inasmuch as a large 
degree of error is to be associated with four-fold matrices of so few 
entries, only values of +.55 (diagonal entries amounting to 70 per 
cent or better) were considered for interpretation. These data 
indicate the Stereopathic students to be somewhat more active 
participants in the classroom process, as reflected by the frequency 
of thoughts involving evaluation of the class process. Thus, they 
are more frequently involved in considerations of the relevance, 
accuracy or meaningfulness of some class activity. The object of 
these evaluations most often involves another student in the class, 
however, and their tone is largely negative in character, involving 
either direct expression (covert) of discomfort, pain, tension, and 
annoyance, or at best, ambivalence. In contrast, the N’s tend to 
participate passively, simply following or listening to the idea 
under consideration. Furthermore, their thoughts are oriented in 
terms of the present, whereas the Stereopaths are reflecting more 
commonly upon past events. 

Ratings of these students by their instructors were made on five 
scales: (1) Open-Mindedness, (2) Emotional Adjustment, (3) Ex- 
tent of Classroom Participation, (4) Type of Classroom Participa- 
tion, and (5) Academic Potential. The average rating on all five 
scales is higher for the N’s, the correlation between Inventory score 
and Overall Rating being +.84. This stems largely from the fifth 
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scale, which was designed as a measure of the extent of identifica- 
tion between instructor and student (see Ch. 9.). . 

These data suggest, on the one hand, that the Stereopath is en- 
gaged in covert behavior in the classroom which is predominantly 
critical and hostile, and secondly, that the instructors are inclined to 
respond less favorably to these students than they do towards the 
N’s. This is a further reflection of the essentially non-supportive 
atmosphere of the College towards S-type students. Both the scho- 
lastic and social environment of this institution are in large meas- 
ure opposed to the rigidity, conventionality, dependence, and 
general orientation of the presumed Stereopathic individual. 
Furthermore, the College's high scholastic standards require that a 
student be able to draw freely upon all of his abilities. To the extent 
that the effective energy of the Stereopath may be assumed to be still 
further reduced by the degree of anxiety and repression character- 
izing representatives of the syndrome, it seems likely that such stu- 
dents encounter much greater difficulty in their adjustment to the 
College program during the first year than is true of the N’s. 

The Stereopathic student might be expected to resolve the 
problem of adjusting to this situation in one of three ways. His 
capacity for rigid categorization of experience may be utilized in 
the divorcing of an alien environment from other life activities. 
By separating and compartmentalizing conflicting experiences in 
this way, the threat of inconsistent or opposed values is minimized. 
To the casual observer such an individual appears to be making a 
good adjustment. The cost in psychic energy is great, however, but 
in the absence of intensive psychiatric and clinical study this out- 
come cannot be detected. 

If the individual is unsuccessful in thus isolating the source of 
threat, or if the conflicting tensions continue to mount, signs of 
disturbance will be observed in his everyday behavior. The student 
with an excellent high school record, of high intelligence, will show 
signs of deterioration by unaccountably failing in one or more 
areas. Difficulty may be observed in maintaining adequate social 
relations with peers, instructors, dormitory heads, or advisers. 
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Direct signs of inadequate emotional control may be shown. If 
sufficient insight is present, therapy may be sought, but this seems 
an unlikely step for the anti-intraceptive Stereopath. 

A final alternative involves escape from the traumatic experience. 
The Stereopathic student may transfer to another school, perhaps 
one more likely to provide the type of atmosphere he would regard 
as comfortable. Or he may simply withdraw from further educa- 
tional pursuits, either temporarily or permanently. 

With these speculations in mind, the records of the Dean’s Office 
were examined for relevant information. Such data tend to be 
erratic and not always reliable for this purpose. Some cases may 
include evaluations by several instructors, records of conferences 
with the student’s adviser, as well as references to psychotherapeu- 
tic aid when sought. Other folders contain little more than a record 
of course enrollment, quarterly grades, and brief comments by the 
adviser indicating no more than that routine appointments had 
been kept. Nevertheless, extremely significant differences were 
found to exist between the records of Stereopathic and Non-Stereo- 
pathic students. The categories employed in the following analysis 
were established in advance, and the actual culling and coding of 
materials from the files of the selected students was done by assist- 
ants who were uninformed as to the purposes of the study and un- 
aware of the identities of their cases with respect to syndrome 
representation. The final tallying was done mechanically by sepa- 
rating the undifferentiated alphabetical list of students and coded 
data into the respective N, R, and S sub-groups. 

Examination of the records for the 162 selected cases in the first 
entering class studied indicates thirty per cent of the Stereopaths 
to be making a comparatively poor adjustment to the College, as 
evidenced by advisers’ comments concerning emotional stability 
or behavioral erraticism. The Non-Stereopaths’ records, on the 
other hand, contain such comments in fifteen per cent of the cases. 
This difference is in the expected direction and is significant beyond 
the .05 level. 

It was suggested earlier that, although the disturbed student 
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might be likely to turn to therapy for help, the Stereopathic indi- 
vidual who is in need of aid is unlikely to do so. This follows from 
the anti-intraceptive character of the syndrome, as well as the 
tendency to employ mechanisms of projection, aggression, dis- 
sociation or displacement, thereby avoiding conscious representa- 
tion of the underlying source of conflict. Although it was impossible 
to obtain complete evidence on recourse to therapy, the Student 
Health Service and Counselling Center files themselves indicate 
that forty-two per cent of the Non-Stereopaths giving evidence of 
emotional disturbance are in therapy, whereas only seventeen per 
cent of the disturbed Stereopaths have sought aid from these two 
agencies. This difference is significant beyond the .05 level. 

With regard to complete withdrawal from the College program, 
it was found that twenty-three per cent of the Stereopathic students 
had dropped from school by the end of the first year, and practically 
all of these by the end of the first semester. These students account 
for thirty-eight per cent of all withdrawals from the College among 
the group of entrants of which they were a part. OF the remaining 
sixty-two per cent, all but one are from the middle range of the In- 
ventory distribution as indicated in Figure 6, and two-thirds of 


these have scores below the mean, i.e., on the 


Stereopathic half of 
the distribution. 


Although twenty-three per cent of the Stereopaths have with- 
drawn from the College, only one per cent of the Non- 
have done so in this same period of time. This differenc 
the expected direction and is significant beyond th 
When withdrawals are added to cases remaining in the 
showing signs of disturbance as seen by their advisers, t} 
come fifty-three per cent for the Stereopaths and sixtee 


the Non-Stereopaths, yielding a probability of differe 
ble to chance well beyond the .001 level. 


Stereopaths 
e is again in 
e .001 level. 
program but 
he figures be- 
n per cent for 
nce attributa- 


Of the three alternative outcomes which were stated earlier as 
likely to characterize the Stereopath, i.e., compartmentalization, dis- 
turbance, or escape, the evidence relevant to the latter two which 
was presented above accounts for fifty-three per cent of the eighty- 
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one Stereopathic cases. One may wonder how much more of this 
group would be accounted for if clinical data were available for the 
assessment of anxiety and psychic impairment. 

These data were based on cases unmatched for intelligence. The 
lower ACE scores of the Stereopathic group may also be a factor 
affecting the likelihood of withdrawal from the College, however. 
For the matched groups the percentage of withdrawals becomes zero 
per cent for the Non-Stereopaths and twenty per cent for the Stereo- 
paths. This difference is significant at the .001 level. When con- 
trasted with the previous percentages of one and twenty-three re- 
spectively, this is indicative of the insignificant role which intellec- 
tual capacity has played in determining withdrawals among the S's. 

The records of these withdrawals from among the S’s indicate a 
number of common characteristics. All of them were receiving low 
grades. Their purpose in coming to the College, as stated in the ad- 
mission form, uniformly reflects the influence of prestige associated 
with the University and the function of education as a basis for fu- 
ture financial standing. Their vocational goals are relatively well- 
defined, and considerable concern is evinced in connection with 
status roles in later years. 

The marked differences between N’s and S’s with regard to voca- 
tional preferences is brought out particularly clearly in Figure 7, in 
which the choices indicated by these students at the time of applica- 
tion for admission to the College have been tabulated. Two inher- 
ent limitations in these data should be noted at the outset. Firstly, 
the youth and inexperience of these College entrants may occasion- 
ally result in their making choices at this time which are unrealistic 
and naive, being based on inadequate information regarding char- 
acteristics of the field in question. Thus, a Non-Stereopath who in- 
dicated major interest in physics at the time of entrance later shifted 
to psychiatry at the end of the year, telling his adviser that “Physics 
is too impersonal—not enough dealing with people.” Another dif- 
ficulty stems from the wide range of roles which are offered in some 
fields of activity, giving opportunities for the implementation of a 
variety of patterns of personal needs. In medicine, for example, one 
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may be physician, surgeon, psychotherapist, administrator, research 
technician, statistician, teacher, etc. Preference for the major field, 
i.e., medicine, is ambiguous, then, insofar as specific roles are con- 

a 
cerned. 


[Z] won-sTEREOPATHS 
NE 


ATIONALS 
FORM S SAMPLE 
[L] stereoratus ny= nos BI 
p<.00! (y?) 


FORM T SAMPLE 
n=n2=n3=: 65 


p<.001 (X?) 
CONSUMMATORY INSTRUMENTAL 

ACTIVITIES ACTIVITIES 
INTERPERSONAL EXPRESSIVE IMPERSONAL IMPERSONAL INTERPERSONAL 
e.g. ea. es. eo. 2.9. 
Psychology Music Philosophy Accounting Business 
Sociology Art Theory Engineering Low 
Teaching Literoture Medicine 

FIGURE 7 


Vocational preferences characterizin 


g representatives of the N, R, and S 
syndromes 


Despite these limitations, the tabulation of vocational preferences 


shown in Figure 7 gives striking confirmation to our hypotheses re- 


garding the relationship between vocational choice and motiva- 
tional characteristics inherent in the 


personal dynamics postulated 
for representatiy 


es of these syndromes. Instrumental activities ac- 
count for over two-thirds of the vocational interests cited by the 


Stereopaths. In contrast, more than two-thirds of the activities listed 
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by the Non-Stereopaths reflect consummatory pursuits involving 
interpersonal relationships or self-expression. The probability of 
obtaining these distributions by random sampling from the same 
universe is far beyond the .001 level. 

Although few of the Stereopathic students who withdrew from 
the College gave explicit reasons for leaving, the records suggest 
their disappointment at having been held for so many courses. The 
fact that most of them withdrew during the first quarter lends some 
support to the conjecture that these students had expected the Col- 
lege to be a short cut to professional status. In view of their previous 
academic record, they seem to have wishfully anticipated complet- 
ing the College requirements largely through placement test per- 
formance. The realities of the placement test results, requiring com- 
pletion of a two- to three-year program before entering an Upper 
Division, sent most of them either to the army or to work. In gen- 
eral, these students seem to have more ambition than capacity, al- 
though their most serious limitation is due to the autistic nature of 
their goals rather than to intellectual deficiency. 

Comments to advisers reflect the S's dissatisfaction with the 
courses and their feelings of being lost and out of place in the Col- 
lege. Their complaints about the program are stated with respect to 
“lack of discipline, . . . lack of compulsory attendance, . . . tol- 
eration of smoking in the classrooms, . . . unwillingness of instruc- 
tors to give the right answers, . . . irrelevance of course work to 
vocational goals.” Emotional instability is reflected in many cases, 
ranging from “inability to study” to “nightmares of being chased 
by Germans and Russians,” and family conditions are often indi- 
cated to be unhappy. 

Although only one of the Non-Stereopaths withdrew, in order to 
attend a school where he can obtain an M.S. in chemistry more 
rapidly, seven per cent of this group are no longer in the College for 
an entirely different reason. These N’s completed the requirements 
of the College, four by fulfilling all requirements for the degree and 
two by special tests, during their first year. Only three other stu- 
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dents in this entering class equalled this performance, two by spe- 
cial tests. = 

The two N’s transferring from the College to the Divisions by 
special tests differ from the others in being in their mid-twenties, 
One, the wife of a theological student in a liberal denomination, 
had had two years of college elsewhere and should not properly have 
been enrolled in the College in the first place. The other is a mar- 
ried veteran, with one child, who received some training in a Eu- 
ropean college through ASTP during the war. ; 

The four who received degrees all entered directly from high 
school. They are all described by their advisers as “brilliant, ma- 
ture, and friendly.” Their vocational goals are uncertain, each in- 
dicating a hope that liberal education might help them reach a de- 
cision with respect to their future careers. As one of them put it, 
however, he “placed out of so much that little opportunity is left 
for browsing.” 

The differentiation of students into N's and S's afforded by the 
Inventory has actually been too successful. Inasmuch as a highly 
selective placement and attrition exists for the two groups studied, 
comparisons of performance for those who remain are made diffi- 
cult. The Stereopathic sample is either depleted by withdrawals or 
enrolled in introductory courses from which the Non-Stereopaths 
were excused on the basis of the placement test results. In addition, 
many of the N’s are being held for only a small number of terminal 


courses, and some have already transferred to a Division by mid-year 


as the result of special tests. It is not too surprising, therefore, that 


analysis of comprehensive performance reveals no differences that 


are relevant to this study, either between the two groups in the few 


courses where there are a sufficient number of both to make com- 
parison possible, or between either group and their classmates in 
those courses where only one sample of the two is represented. How- 
ever, an independent replication of this study at another college of 
a similar character, but with a less flexible placement program, not 
only confirmed the major findings reported here, but also yielded 
data indicating significant differences in actual course achievement 
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in the Social Sciences and Humanities favoring the Non-Stereo- 
paths. 


Validation of the Syndromes 


In one sense the very pattern of differences found to distinguish 
students identified as N’s and S's by the Inventory of Beliefs appears 
to constitute a validation of the synthetic models proposed origi- 
nally. However, these differences might well be the consequence of 
some factor peculiar to the Inventory itself that has nothing to do 
with the postulated syndromes. From a pragmatic point of view this 
is not particularly important; insofar as the discrimination made by 
the Inventory is useful for educational purposes, it does not matter 
particularly just why it happens to discriminate in this fashion. 

It has been our purpose to demonstrate that assessment must 
necessarily go further than this, however. A more direct demonstra- 
tion of the validity of these models is necessary if any confidence is 
to be placed in a methodology based upon the derivation of propo- 
sitions regarding behavior from synthetic personality patterns. As 
an approximation to such a direct validation, blind analyses of pro- 
jective data were made for twenty cases among the first group of 
entrants (ten N’s and ten S's), and repeated with thirty cases from 
the entrants of the following year (ten N’s, ten S’s, and ten R’s). 
Activities Index, TAT, and interview data were available for all of 
these subjects. 


ACTIVITIES INDEX 

A preliminary analysis of these cases was based on the Activities 
Index. Table 15 lists items which discriminated most sharply be- 
tween representatives of the three syndromes. It will be noted that 
many of these items indicate the preference of the N’s and the an- 
tipathy or indifference of the S's for activities characteristic of the 
Humanities and Social Sciences, giving further support to the sig- 
nificance of differential performance in these areas referred to previ- 
ously. 
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Table 15. Activities Preferences* Characterizing Selected N, R, and S Stu- 


1. DIFFER! 


dents (n; = nz = n; = 48) 


ENCES BETWEEN N AND S 


a. Preferred by N, Disliked by S 


40. Arguing with an instructor or supervisor. 


72 


81 
168 
222. 


198. 


247. 


- Disregarding rules and regulations that seem unfair, even though | might suffer 
for it. 


+ Organizing a protest meeting. 
. Studying the music of particular composers, such as Bach, Beethoven, etc. 
. Rereading favorite books over and over again. 


Doing things with my hands: manual labor, manipulation, or construction. 
+ Standing on the roof of a tall building. 


b. Preferred by S, Disliked by N 


44 
84. 
60. 
88. 
184, 
155. 
240. 
252. 


- Keeping out of trouble at all costs. 

. Watching a good fight. 

. Recopying notes or memoranda to make them neat. 

. Erasing thumb prints and marks from a book. 

» Leading a well-ordered life with regular hours and an established routine. 
. Finding one restaurant I like and eating there whenever | go out. 

. Managing a store or business enterprise. 


. Thinking about how to become the richest 


and cleverest financial genius in the 
world. 


c. Preferred by both S ond R, Disliked by N 


24, 
52. 
49. 
62. 
167. 
97. 


Keeping my bureau drawers and desk in perfect order. 
Arranging my clothes neatly before going to bed. 
Keeping an accurate record of my expenses. 

Finishing something I’ve begun, 
Working in science or mathemat 
Sleeping on a very soft bed. 


even if it is no longer enjoyable. 
ics rather than art or music. 


2. SIMILAR PREFERENCES FOR N AND R 


Al. 
148. 
160. 


151. 
208. 


234. 
260. 


Living on my own, away from home. 
Taking care of youngsters. 

Writing about political or social issu 
by Congress, revolutions, etc. 
Sketching or painting. 

Learning to recognize the work of Particular artists, such as Rembrandt, Whistler, 
Van Gogh, etc. 

Writing a fine book rather than bein 
Spending my time on abstract thoug 


es, problems or events, such as bills passed 


g an important public figure. 
ht and discussion. 


218. Walking along a dark street in the rain. 


225. Making up and eating odd mixtures. 
283. Driving fast. 


3. SIMILAR PREFERENCES FOR R AND S 


12. 


55. Repeating something I’ve done, 
63, 


48. 
201. 
241. 
267. 
242. 


Being polite or humble. 


to be absolutely certain I’ 


ve done it correctly, 
c assignment of work to do rather 


Being given a specifi than a loose, general di- 


rection. 
Belonging to a boy’s or girl’s club. 
Achieving wealth and social Prestige through success in Practical affairs, 
Imagining how it would feel 


to be rich and famous, 
Learning how to make lots of money. 


Setting myself tasks to strengthen my will power. 


216 


A Synthetic Study of College Freshmen 
256. Having to fight for something | want. 
266. Reading science fiction. 


4. PREFERENCES PECULIAR TO R 
34. Trying to figure out how I was to blame after getting into an argument with 


someone. 
122. Having people ask me about myself. 
207. Working on tasks so difficult | can hardly do them. 
223. Imagining situations in which | might be a hero. 
281. Having daydreams which almost seem real. 
271. Doing something which will create a stir. 


5. PREFERENCES PECULIAR TO S 
9. Suffering for a good cause or for someone | love. 


246. Risking my life to save someone. 
120. Being with someone who always tries to be sympathetic and understanding. 


164. Being generally consistent and unchanging in my behavior. 
211. Selecting foods carefully for their health-giving nutritive qualities. 


* Based on discriminating items from Activities Index, Form 952. 


In addition, these data reveal the N’s as preferring activities re- 
flecting autonomous or independent behavior. The S's reject such 
activities, their preferences reflecting orientation towards the 
achievement of financial status and security, compulsive orderli- 
ness, and submissive or dependent behavior. The R’s are distin- 
guishable on this instrument in terms of a high degree of interest in 


abstract and analytical intellectual activities, coupled with an in- 
difference towards social and personal relationships. An overall 
summary of findings based on the entire record provided by the Ac- 
tivities Index indicates that: 

1. In their preferences for social interaction, the Stereopaths 
were more approving of deference to authority figures, wished to 
remain in the parental home, were less nurturant toward or inter- 
ested in younger persons, and were in general less interested in 
interpersonal activities than were the Non-Stereopaths. 

2. The Stereopaths tended to inhibit the expression of their feel- 
ings, preferring more stress on orderliness and control. They dis- 
liked sentient experiences and were more fearful of activities likely 
to elicit feelings of inferiority than were the Non-Stereopaths. 

3. With respect to ideas and educational interests, the Stereo- 
paths clearly reject emotional and esthetic experiences, as well as 
the analysis of social and political processes. 
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Among the N’s and R’s a number of further distinctions were 
obtained: . 

1. The N’s are specifically concerned with maintaining their 
autonomy or independence, being continually provoked by heap: 
pearance of potential authority into engaging in outright rebellion. 
The R’s, on the other hand, are more conforming to social pressure. 
Their conformity is of a passive nature, however, as distinguished 
from the active flight into conformity characterizing the S's. On the 
basis of these findings alone, it would have perhaps been more ap- 
propriate to have referred to the R's as “non-stereopathic” and the 
N’sas “anti-stereopathic.” 

2. Both N’s and R's exhibit strong needs for achievement in 
academic or scholarly pursuits. The N’s interests run chiefly to 
humanistic and expressive activities, frequently involving intimate 
personal interaction with others. In contrast, the R’s are more con- 
cerned with detached, abstract, and analytical intellectual activities. 

3. The greater passivity and detachment from interpersonal re- 
lations characterizing the R’s is further manifested in their more 
explicit fantasy life. Both N’s and $’s, each in their own highly 
distinct fashions, appear to be too involved in the acting out of fan- 
tasy to distinguish between that which is almost true and that which 


is. The R’s achieve some of their basic satisfactions from conscious 
daydreams and wishes, however, 


which are explicitly recognized 
and valued as such. 


BLIND ANALYSES 

Thus the data from Activities Index are congruent with the 
personality syndromes for which the Inventory of Beliefs was origi- 
nally developed. Additional cross-validational data are available 
from other sources—the TAT and a brief interview that was con- 
ducted to elicit material regarding the subjects’ vocational interests 
and their evaluations of their families. The data on the twenty cases 
from these two sources were analyzed blind] 
made to assign each case to its appro 
the Inventory of Beliefs. 


y and the attempt was 
priate group as identified by 
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The results of this classification, performed independently by 
two judges, are shown in Table 16. Table 17 shows the results of a 
similar blind analysis performed with thirty cases obtained from 


entrants of the next entering class. 


Table 16. The Relationship Between Inventory (Form S) Identification of 20 
Syndrome Representatives (10 S, 10 N-R), and the Independent 
Judgment of Two Assessors Based on Unidentified Projective Pro- 


tocols 
ASSESSORS’ DESIGNATIONS 
sS N-R 
Inventory s 18 2 
Designation N-R 2 18 
(Form S) 


Table 17. The Relationship Between Inventory (Form T) Identification of 30 
Syndrome Representatives (10 S, 10 N, 10 R), and the Independent 
Judgment of Two Assessors Based on Unidentified Projective Pro- 


tocols 
ASSESSORS’ DESIGNATIONS 
s N R 
Inventory S 17 4 2 
Designation N o 13 7 
(Form T) R 3 6 "m 


It should be noted that Form S, employed with the earlier group, 
provides no basis for differentiating N’s from R’s. In the case of the 
first group, therefore, this discrimination could be made only by 
the judges. The interjudge agreement on these twenty cases is 
shown in Table 18. The latest version of the Inventory, Form T, 
was used with the second group of entrants; it provides a criterion 
score for all three syndromes. Table 19 indicates interjudge agree- 
ment for the thirty cases employed in the second analysis. 

The data in these tables indicate firstly that a considerable degree 
of agreement existed between both judges in the independent clas- 
sification of these protocols. To only a slightly lesser degree, each 
judge was in agreement with the classifications provided by the sub- 
ject’s scores on the Inventory of Beliefs. There is evidence in these 
tables for a greater recognizability of the Stereopathic cases, each 
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judge making only one error among the ten Stereopaths of the first 
group, and one and two errors, respectively, among ten similar 
cases in the second group of entrants. As can be seen particularly in 
Table 17, somewhat more confusion existed in distinguishing N’s 
from R’s, than in distinguishing either of these from the S’s. 


Table 18. Interjudge Agreement in the Identification of 20 Syndrome Repre- 


sentatives From Independent Analyses of Unidentified Projective 
Protocols (Form S Sample) 


JUDGE 1 
S R 
S 9 0 1 
Judge N o 5 o 
2 
R 1 0 4 


Table 19. Interjudge Agreement in the Identification of 30 Syndrome Repre- 


sentatives From Independent Analyses of Unidentified Projective 
Protocols (Form T Sample) 


JUDGE 1 
sS N R 
S 9 0 1 
k N 1 8 1 
R i) 2 8 
Table 20. Per Cent Obtained Agreement Between Two Independent Judges, 
and Between Each Judge and the Inventory of Beliefs, in Identifying 
Syndrome Representatives From Independent Analyses of Unidenti- 
fied Projective Protocols 
FORM S SUBJECTS FORM T SUBJECTS 
(Two groups of 10 cases each) (Three groups of 10 cases each) 
JUDGE 1 JUDGE 2 JUDGE 1 JUDGE 2 
Agree- p* Agree- p* Agree- p* Agree- p* 
ment ment ment ment 
Inventory 90% .0005 90% -0005 70% .0002 67% .0004 
Judge 1 — = 90% -00001 _ — 84% .00001 
Judge 2 — — — 


* Exact probabilities computed from combinatorial function. 


Table 20 shows the per cent agreement obtained between each 
judge and the Inventory, and the exact probabilities associated with 
this performance. It should be noted that the judges’ task with re- 
spect to the twenty original cases who had been administered Form S 
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of the Inventory was to classify the twenty into two groups of ten 
cases each, whereas the thirty cases in the replication who had been 
given Form T of the Inventory had to be classified into three groups 
of ten cases each. The discrimination is thus considerably more dif- 
ficult for the tripartite division entailed in the replication. 

These two tables indicate the high degree of precision with 
which these cases were differentiated by means of blind analyses of 
projective data. With both sets of cases, however, the judges are in 
more significant agreement with one another than they are with the 
Inventory. Although these data substantiate the validity of the In- 
ventory as an index of the three hypothesized syndromes to a 
marked degree, they also indicate that the projective data were a 
somewhat more reliable diagnostic medium as used by the various 


judges than was the Inventory itself. 


PROTOCOL CONTENT 


The non-random nature of these classifications is given further 
credibility by the consistency of the projective data for cases as- 
signed within each of the three syndromes, as well as the consistency 
between these data and the more objective material presented pre- 


viously. 


The S Protocols. The S protocols are characterized typically by 
banal and stereotyped phraseology, submission to authority figures, 
codifications of personal relationships, suppression or inhibition of 
sexual and sentient responses, defensiveness, and strong status 
needs. All cases give evidence of a strong, fearful authority figure. 
Reactions to this figure varied, some perceiving it as a super-being, 
e.g., God or the Police, and allying themselves with this Being rath- 
er than their parents. In this case subservience was given to an 
authority super-parental, without basic change in hierarchical re- 
lationships, however. In some cases resentment of parental authority 
is indicated, but parental right to authority remains unquestioned. 
Furthermore, it is suggested that resistance is purposeless and, in 
the end, the advantages of having accepted coercion will be realized. 
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Extremely positive parental concepts are coupled with underlying 
hostility. The hostility is not allowed consciously to interfere with 
the unrealistic exaltation of the parent, however. Furthermore, 
little evidence of active counter-ageression is shown, except where 
parents were perceived as opposed to higher law. Guilt associated 
with the repressed hostility is frequently found coupled with pio- 
jected aggression. Some cases not only externalized their aggression, 
but felt themselves the butt of it. 

There were indications that the strongly repressed impulses oc- 
casionally burst forth in sudden, intense outbreaks. When this oc- 
curs, these subjects feel no responsibility for them at the time of 
expression. The impulses are felt to be alien, momentarily over- 
whelming the individual and paralyzing any possible effort at con- 
trol, Once control has been regained, the damage is viewed with 
horror. Moralism returns and penance must be paid, even to the 
extent of suicidal thoughts. Considerable conflict is reflected in the 
sexual area. Sex is perceived as brutal and low, something to be de- 
spised. Paralleling this is a split in the mother-concept; there is no 
overlap between the good, provident female and the 


Emphasis on superficial masculine qualities in th 
figures is frequent. 


Introspection occurs rarely, if at all. These subjects think of 
things in completely objective terms, as factually and absolutely 
right or wrong. Goodness and badness are absolute, unquestioned 
concepts. They seem psychically incapable of tolerating the un- 
certainty of an intermediate opinion. In almost every instance, an 
air of ponderous seriousness runs through these protocols. Self and 
situations are treated with humorless gravity. Conformity to socie- 
tal rules and evaluations substitutes for true inne 
Group morality and status provide the standards 
evaluation is accomplished. 

Some examples of these y 
lowing excerpts from the T. 


sexual partner. 
e case of male 


r-directedness. 
by which self- 


various points may be found in the fol- 
AT protocols of the Stereopaths, 


1. (Boy with violin.) The 


boy is being forced to do something that 
he has no wish to do. 


His mind is not mature enough to cope with 
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those of older folks, who are making him study music; but it should 
be sufficiently developed to enable him to know what he does and 
does not wish to do. Perhaps he wants to be outside playing base- 
ball; but this is not good either. If someone would introduce him 
to a good book, I think he would be much happier. 
(Farm scene.) This is a picture of the principles behind America. 
The father, by the sweat of his brow, is endeavoring to earn for his 
child a good education. The mother is praying for success. The 
child is surely trying to be worthy of those hopes which are nour- 
ished by her parents. She may be studying agriculture, possibly 
medicine; but surely not any subject like poetry and art, because 
her parents are solid people who like to have a solid foundation. 
13. MF. (Nude figure on bed.) The man in the picture has just finished 
dressing. The woman in bed is a prostitute. After his former wife 
left him, he has degenerated terribly. He realizes he is getting worse 
and worse, but can do nothing to stop himself. He covers his eyes 
to hide from his real self and from reality. He finally commits 


N 


suicide. 
16. (Blank card.) The scene is a poorhouse. The people are all grouped 


about a long table; on it—one loaf of bread (dry) and a gallon of 
water (stale). One of these people has in his hand a palette, another 
has a piano strapped to his back. Gradually the picture fades away. 
The scene is the same again, but the place is an insane asylum. In 
it, all of those who reached toward intangibles. 
The N Protocols. Protocols of the N subjects indicate an absence of 
obedience to super-authority figures or to control by external forces. 
‘The records are rich with colorful tales of rebellion, impulsiveness, 
and sexuality. These subjects appear as highly autonomous indi- 
viduals, responsible mainly to themselves for their own acts. Au- 
thority figures are clearly perceived, and vary from possessive ma- 
ternal figures to friendly parental concepts. There seems to bea 
conscious recognition of parental coercion, and knowledge of how 
to effectively reduce such authority. 

The female N’s appear somewhat active and aggressive, although 
retaining a store of feminine wiles with which to insure the realiza- 
tion of their demands. The male N's, on the other hand, are more 
passive and seem to have formed a feminine identification. Intellec- 
tual interests occur chiefly in the form of self-expression, creativity, 
and esthetic appreciation. These interests represent a form of sen- 
sual self-indulgence for this group. Introspection is common. 
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These subjects seem willing to accept their impulses and develop 
expression in artistic and esthetic activities. The men forego con- 
stant demonstrations of masculinity: sensual appreciation is toler- 
ated without guilt or conflict. They tend to be relaxed, passive, and 
tolerant of differences. The women, on the other hand, are more 
demonstrative, more intent, more rigid in defense of their interests. 
They seem to be fighting to achieve a masculine, dominant status, 
and in so doing identify and fight for other discriminated minori- 
ties. If this sex difference is genuine, the females of this pattern 
seem even more truly “anti-stereopathic” than “ron-stereopathic.” 

Some examples from the TAT protocols of the N's follow: 


6. BM. (Elderly woman and younger man.) The boy has been tied 
to his mother’s apron strings all of his life and now wants to do 
something on his own, His mother is very much hurt by his attitude. 

13. MF. (Nude figure on bed.) Well, they had gone together for a long 
time. Everybody insinuated and made snide remarks, but they were 

always able to keep themselves from it. Now, it had happened, But 
the thing that worried Bob was not the fact that she might have 
a baby, but whether he really loved her. He'd always thought that 
he would never do it because he loved her, And then he felt the 
worst; it was obvious. . . . All too obvious. 
(Blank card.) A magnificent horse running free against a back- 
ground of Wyoming scenery—mountains and such. He has the look 
of defiance about him. He is thin as though he has come a long 
way without food or water. Though he has been chased by men 
many times, he has never been caught. If a rope touches his neck, 
he would kill the man who held it and if trapped, he would kill 
himself before allowing a human to lay hands on him. 


16. 


The R Protocols. Among the R subjects authority figures are de- 


picted without awe or threat. Whether vague or clear, such figures 
appear fallible and surmountable. Both authority and the self seem 
at the mercy of unidentifiable, external governing forces. Rebellion 
or resentment are permissible, but to no purpose. Regardless of 
what one does, the outcome is established by external dictates. Un- 
derlying this is a feeling of futility and of passive resignation. The 
self is detached from this inevitable process, and looks on in sar- 
donic appraisal. 
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Evidence of shame, abasement, or the repression of aggression is 
not clear. Rather is there indication of superego laxness, and an 
absence of guilt feelings. Impulses are allowed relatively free ex- 
pression, with an undertone of resignation to inner states over 
which control is apparently futile or purposeless. Although bitter 
and sardonic, there is seldom direct counteraction. Rather, intel- 
lectualization and analysis are employed as substitutes for active 
personal interaction. These subjects seem passive, not really 
touched by things, their exertions only halfhearted. They stand 
apart in aloof detachment: observing, remarking, understanding, 
and theorizing. The observations and inferences are not always 
checked too closely, however. It would have perhaps been more 
appropriate to label these subjects as the “non-stereopaths,” rather 
than the “‘anti-stereopathic” N’s. The protocols provide the follow- 
ing examples: 


1. (Boy with violin.) There was once a little boy who didn’t like to 
play his violin. As no little boy likes to play the violin, this one was 
no exception. He was supposed to play in a children’s concert, but 
he hated to practice for it. One day, when he was supposed to be 
practicing, he ran off to the dark, cool, green woods which looked 
so inviting. The concert was the next day, so all the townspeople 
came out looking for him. They finally found him, one hour before 
the concert, under a tree. After he got home, he still rebelled at the 
thought of playing the violin, and this is where we see him, moping 
now. 

16. (Blank card.) There are two tall, thin trees in the middle of the 
picture (one is slightly larger) and right between their roots is a 
spring which is overflowing. The picture is of a bright spring day, 
and everything is very wet from the melting snow, and you can see 
that the ground is so wet that it would squish if you stepped on it. 
There are lots of small noises, water dripping and birds, and off in 
the distance, a car motor and a cow mooing. 

16. (Blank card.) John is scared. He is on a horse, galloping off across 
the fields. He had wanted it to trot, and now it was galloping. In 
ten seconds, the horse stopped as abruptly as it had started. John 
was glad. 

16. (Blank card.) This is space. All is empty, devoid of matter. All is 
life. All is nothing. The mere specks of dirt represent human life, 
the space around them is eternity. Through this space ghosts of men 
who have died fly. The specks of dirt accumulate and grow larger, 
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just as life. Life grows and finally it extinguishes itself and becomes 
invisible space. Again new specks of dirt as life occurs and a new 
cycle is occasioned. This continues on endlessly. 


Summary 


The study reported upon here represented an attempt to test the 
limits of a hypothetical personality type. Having defined a theoretic 
entity in lengthy clinical terms, an instrument which seemed likely 
to identify representatives of the pattern was developed. Some 357 
students out of over 900, whose scores on this instrument suggested 
them to be reconcilable with the typology or diametrically opposed 
to it, were then studied in detail. 

Differences between these groups in terms of specific abilities, 
achievement, adjustment, personal background, and personality 
dynamics (not all of which were reported here), indicate clearly the 
extent to which initial formulations regarding the typology were 
justified. It seems fairly clear that a portion of the student body, 
homogeneous with respect to a wide variety of sociological, psycho- 
logical and emotional characteristics which are concomitants of the 
personality type hypothesized, can be isolated and identified. These 
students not only show considerable antipathy to and lack of po- 
tential in certain areas of general education as presented at the 
College studied, but they are also remarkably consistent in their 
interests, attitudes, and orientation toward life. The pattern ap- 
pears to be quite stable with time and is broadly represented among 
college students, if not in the general population. The percentage 
of such students at other colleges and universities in the country is 
suggested as even larger than the sixteen per cent encountered in 
this particular College. 

In contrast to this pattern, two polar alternatives are indicated 
which are no less clear in their consistency and recognizability. The 
frequency of occurrence for these other two types in the general col- 
lege population in the country at large would seem to be somewhat 
less, however, than is the case for the syndrome initially specified. 


226 


A Synthetic Study of College Freshmen 


The capacity of the Inventory of Beliefs to differentiate three 
types of students is a demonstration of the utilization of available 
theory for the development of personality syndromes and their sub- 
sequent use in what we have called a synthetic approach to assess- 
ment. Although not discussed at any length in this chapter, it is 
apparent that the obtained results pose a number of problems for 
further consideration. Their significance for education seems to lie 
in further study of the relationships between the syndromes dis- 
cussed here and the learning process. What implications does dif- 
ferential academic performance attributable to personality char- 
acteristics independent of ability have for admission practices, for 
guidance, for classroom procedures, for curriculum planning, and 
for educational objectives? Are there biases in existing selection, 
teaching and examining techniques which give a greater advantage 
to certain personality types, at the expense of others? Can instruc- 
tional methods be devised which will succeed in increasing the 
participation of representatives of these syndromes in activities 
which they now find unacceptable? Would longitudinal studies 
reveal fewer clear-cut representatives of the various syndromes at 
later stages of matriculation; if so, is this the result of self-selection 
through withdrawal, or do real intrapersonal changes take place as 
a consequence of the educational program? 

Similar questions might be raised in connection with the conse- 
quences of these syndromes for personal adjustment and mental 
health, for group participation, and for vocational performance. Of 
more general significance is the problem of the etiological factors 
behind these patterns. Under what conditions do they develop, and 
to what extent can they be modified? Can further models be de- 
veloped, characterizing additional groups of persons from among 
those not represented by the three syndromes described here? It 
would appear as if the extension of our present techniques in order 
to encompass some of these issues would be likely to open up a num- 
ber of interesting areas for investigation, quite apart from matters 
more directly pertinent to assessment as such. 
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A Configurational Approach 


THE SYNTHETIC STUDY REPORTED IN THE PRECEDING 
chapter provides an illustration of a curious phenomenon. Al- 
though it was evident that two important groups of students could 
be identified with considerable precision and economy, these groups 
constituted only a small portion of the total entering class. The re- 
maining two-thirds were discarded, either as representatives of a 
personality typology which had no specific implications for aca- 
demic performance (the R syndrome), or as cases not related to the 
three syndromes to which the Inventory of Beliefs is limited as a 
diagnostic device. - 

But the Non-Stereopaths are not the only students whose per- 
formance is exceptional, nor are the Stereopaths the only ones to en- 
counter difficulty. What this suggests, in fact, is that there may well 
be several different patterns or models required in order to account 
for all of the successful students. There is no particular reason for 
us to assume that there is only one motivational pattern which un- 
derlies success or failure in a given situation. It would seem more 
likely that a number of configurations are to be found represented 
among the total population, each of which is capable of sustaining 
the kinds of interactions necessary to adequate role-fulfillment. 

The synthetic study succeeded in identifying only two such con- 
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figurations relevant to academic performance in this setting, Al- 
though others might be developed over a period of time, their for- 
mulation can be a costly and uncertain process. It would be of 
greater value to devote our efforts to the development of a statistical 
model which could be used in order to isolate and represent what- 
ever typologies are empirically present within the population being 
studied. The purpose of this chapter is to discuss some considera- 
tions relevant to the development of such a tool. 


Multiple Regression Techniques 


A source of difficulty in the analysis of data involving human be- 
havior has stemmed from the indiscriminate application of meas- 
urement techniques. Pressed by the need to transform observations 
into measures, we sometimes overlook the extent to which the sta- 
tistical model employed for this purpose becomes an intrinsic part 
of the data themselves, influencing the conclusions drawn from the 
analysis in unexpected ways. 


Consider the case of the guidance profile or job psychograph, for 
example. A battery of tests is given to several groups of subjects and 
the average scores attained by each group are connected to form a 
profile line. When confronted with the profile characterizing a new 
subject, attempts to assign him to the appropriate group by means 
of a visual comparison of profiles presents us with an awkward prob- 
lem. The individual profile is unlikely to be exactly like any one of 
the group profiles. It falls somewhere between the v 


arious groups, 
the individual being a little better on some tests an 


d a little worse 
on others, in combinations difficult to reconcile with the criterion 
profiles. We wonder whether the scores on the separate tests should 


be combined in some way, how to weight them when this is done, 


the kinds of units to employ, etc., etc. As Rulon recently pointed 
out: 


It is clear that there is no end to these questions, 


and there won't be 
any end to them until the whole misconceived pro: 


file chart is thrown 
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in the wastebasket. The one-dimensional chart with six scales along that 
dimension was an entirely inappropriate model of the situation from 
the very beginning and it doesn’t promise to do anything but raise a 
host of questions, all stemming from the basic unfitness of the portrayal 
(53, p. 82). 


It would seem more appropriate to conceptualize this problem in 
terms of a k-dimensional space instead of a unidimensional profile. 
A point in this space represents a single person, indicating the re- 
lationship between the various measures which characterize him. A 
test, or group of closely related tests, is represented by a vector in 
this space; a person, or group of closely related people, appears as a 
point or cluster of points in close proximity. 

The initial problem in selection is to locate some particular 
group of persons within this space who have been prejudged to 
meet certain qualifications. The members of this criterion group 
have been selected on the basis of their acceptable fulfillment of 
some standard of performance. Thus we may be able to designate a 
group of people who are all good pilots, as judged by the number of 
hours flown without a serious accident or some similar criterion. 
For purposes of comparison we may decide to obtain a contrasting 
sample of poor pilots, or of non-pilots. Sometimes the criterion to 
be used as a measure of the standard of performance can be quanti- 
fied in the form of a continuum of adequacy, enabling us to work 
with a gradient rather than being limited to the consideration of 
“haves” and “have nots.” Establishing a criterion gradient facili- 
tates the adjustment of minimum requirements for a given per- 
formance in accord with the available supply of manpower at any 
particular time. However we happen to proceed, the selected groups 
of persons are employed in an attempt to designate the region in 
space within which these persons fall. If we can descr ibe this region 
in terms of the relationship among a set of test vectors, this descrip- 
tion then becomes the formula by means of which the test per- 
formance of new applicants can be judged as adequate or not. If the 
performance is such as to fall within the critical region which in- 
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cludes the members of the criterion group, it is considered accept- 
able; if it falls outside of it, the candidate is to be rejected. 

If we attempt to locate a criterion group with reference to one 
vector at a time, as in a t-test (mean score of high criterion group 
vs. mean score of low criterion group) or correlation coefficient (re- 
lation between standing on criterion gradient and test score), the 
k-space is being viewed from one direction at a time and no ac- 
count is being taken of multidimensional determinations. Thus, 
some of our good pilots may be characterized by rapidity of response 
and moderate control, whereas others may be represented by a 
slower response but greater precision. In this event we have no way 
of describing the good pilot on either dimension considered sepa- 
rately: some good pilots are slow and others are fast; some good 
pilots are precise, others are not. Good pilots in general, however, 
can only be described by taking into account the relationship be- 
tween speed of response and degree of precision. 

Concomitant determinations from several dimensions are fre- 
quently approached by means of multiple regression technique (33). 
In this case it is assumed that the criterion group can be located 
with reference to several co-ordinates by obtaining a weighted com- 
posite of test scores, reflecting the intercorrelation between tests as 


well as the correlation of each with the criterion. This 


procedure 
involy 


es the construction of unidimensional continua in multi- 
dimensional space. The component elements 


bine additively in a linear fashion, and excesses in one element are 
permitted to compensate for deficiencies in another (14). In the 
case of the good pilot, a multiple regression equation based on both 


speed of response and degree of precision will permit exceptional 
rapidity of response to compensate for 


are assumed to com- 


excessively poor control; 
conversely, individuals would also be accepted whose response is 


extremely slow, providing that the lev 


el of precision is high enough. 
A summative model of this ty 


pe presents an inaccurate picture of 
our group if the behavior involved does not consist of compensatory 
elements, however. Such an alternative is represented by a criterion 
which involves the simultaneous presence of several conditions, 
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each to a minimal degree. In this case, failure to meet any one of 
the minimal conditions for fulfilling the pattern means non-repre- 
sentation in the pattern, and compensation among components 
does not occur (31). In our example, we might have considered a 
limiting value for the speed of response, below which no good pilots 
are to be found. The multiple regression equation would continue 
to designate persons below this point as good pilots, however, pro- 
vided that the value found with the other variable is high enough 
for the sum of the two to fall within the appropriate range. 

The summative model will also prove unsuccessful when the cri- 
terion can be achieved in a variety of ways. If a number of alterna- 
tive combinations of elements exists, each predictive of the same 
criterion, a specification equation will oversimplify and fail to dis- 
criminate between alternatives (even if each is itself internally sum- 
mative). For this case we must think of our pilots distributed in 
k-space, not in a single cluster, however, but in several, occupying 
different regions. Multiple factor analysis is sometimes employed in 
situations like this, on the assumption that the most parsimonious 
ordering of test vectors will enable us to designate a reference vector 
running through the general area within which the whole of our 
criterion group is to be found. 

By means of this procedure a specification equation can be set 
up which establishes a reference vector for the criterion group as a 
linearly dependent function of the set of dimensions. If the points 
indicated by such an equation fail to coincide with the actual loca- 
tions of persons in our criterion group, however, three possible con- 
clusions must be entertained: 

(1) The criterion itself is inadequate and cannot be represented 
by a reference vector in this space—another criterion must be 
sought; 

(2) The criterion is adequate but not representable among the 
present test battery in terms of which this space has been defined— 
a space determined by other dimensions must be sought; 

(3) The criterion is adequate and representable, but is not lin- 
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early related to the various co-ordinates—non-linear relationships 
must be considered. 

The first two alternatives involve discarding part or all of the 
data which have been collected and beginning all over again, either 
looking for a more adequate way of measuring the criterion be- 
havior, or for other ways of describing and measuring the presumed 
components. Let us consider the implications of the 
tive, however. Firstly, there is no particular reason to expect only 
linear relationships in our personality space. In fact, such relation- 
ships might well be the exception rather than the rule. Considering 
possible non-linear representations is for the most P 


third alterna- 


art impractica- 
ble, but it may be possible to discover smaller segments of the “truc” 
reference vector which will behave linearly, even though in its total 
aspect the relationship would be given by some non-linear function. 

On the other hand, the sample of persons may not be homo- 
geneously distributed along the series of points represented by the 
reference vector, whether this line is linear or not. If, in fact, the 
group is represented by a composite of sub-groups, each uniquely 
oriented in k-space, then a multiple factor solution will yield a 
reference line which may pass through none of these regions, and 


be different from that which would be found if a more homog 


ene- 
ous aggregate of individuals had been em 


ployed. Furthermore, fac- 


evere. The statistical repre- 
T, representing the common 
e on the criterion, is of no 


ance can be attained by any 
one of several relatively independent configuratio; 


To the extent that the basic views concerning ass 
ology presented in previous chapters indicate a cor 
heterogeneous typological clusters of persons, so 
statistical tool must be sought for the analysis of 


seniation of the average group membe 
denominator of adequate performanc 
practical use if the criterion perform 


ns of capacities. 
essment method- 
amitment to such 
me more adequate 
assessment data. 
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Configurational Techniques 


TRANSPOSED FACTOR ANALYSIS 


A possible technique for dealing with non-homogeneous popu- 
lations which has excited considerable interest in recent years is 
provided by transposed factor analysis. Mowrer (41) has provided 
an extensive historical summary of the development of this tech- 
nique, making it unnecessary for us to retrace its background here. 
Transposed analysis involves the ordering of data for a tested popu- 
lation by means of the intercorrelations between pairs of persons 
using a series of tests as entries, as distinguished from the conven- 
tional analysis which involves the intercorrelations of pairs of tests 
with a series of persons as entries. Thus, similarities of test patterns 
for pairs of individuals will result in the identification of clusters of 
people occupying neighboring points in k-space. The purpose of 
this procedure is to simplify the population being studied to the 
point where relations between dimensions can become meaningful 
for individual cases. Significant relationships cannot be observed 
when fundamentally different sub-groups are confounded within 
the same criterion sample. When the sample of persons can be more 
properly represented in terms of several sub-groups sharing differ- 
ent aspects of the factor pattern among tests, the test factors will be 
of limited usefulness for predictive purposes unless the existence of 
the separate sub-groups is first taken into account. Independent 
functional unities among tests would seem second in order of analy- 
sis; first it is necessary to establish independent functional unities 
among persons. 

It has been argued, however, that transposed factor analysis is 
incapable of yielding solutions which differ from those afforded by 
means of conventional factor solutions. Both Burt (7, 8) and Cattell 
(9, 10), for example, have insisted that multiple factor solutions and 
the transposed are equivalent, the former being the more desirable 
since technical problems involving pattern elevation, scatter, and 
reliability are minimized. Now, although there have been many 
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studies demonstrating that clusters of persons may be isolated by 
means of transposed analysis, there has been no direct test of the 
difference (or similarity) between both types of analysis when ap- 
plied to the same set of data. 

In order to resolve this issue a study (13) was designed involving 
two specific hypotheses: (a) conventional factor analysis yields fac: 
tors restricted to test variation, and (b) transposed factor analysis 
yields factors restricted to person variation. An artificially contrived 
set of measurements was employed for this purpose, representing an 
extension of the box problem originally presented by Thurstone 
(71, pp. 125-148) in order to incorporate both test and person 


factors in the raw data. The analysis of these data was done by 
Chung (12). 


Table 21. Centroid Solution Based on Intercorrelations Between Fifteen Meas- 
ures of Box Dimensions* 


CENTROID FACTOR MATRIX 


ROTATED 
FACTOR MATRIX 
MEASUREMENT 1 "W m 


ha Az Bz Cs 
x2 84 44 19 9353 62 —,06 104 
y? .80 —.56 —.06 -9572 16 71 09 
z2 90 —.08 35 9389 =.10 14 54 
xy 92 —,26 —.26 9816 21 59 —.05 
xz 96 16 16 9728 «21 -05 39 
yz 87  —.48 .07 9922 —.18 60 24 
Vx2 + y2 97 9 —.14 9966 44 16 10 
Vx? +z? 94 35 04 1.0077 42 —.06 -28 
Vy? +22 98 15 14 1.0025 02 32 36 
2x + 2y 97 .03 —.24 9994 .40 35 .00 
2x +2z 89 36 22 9701 .29 17 44 
2y +22 97 —.25 07 1.0083 .00 44 28 
Log x 84 46 =n 9293 57 = 112 
Log y 85 —.35 =s 9411 17 67 -i 
Log z 92 23 26 -9669 -18 —.07 48 

*Reproduced from B. M. Chu: 


ing, Differentiation of Group Patterns by Transposed Factor Analysis, 
on, The University of Chicago, 1952. 


Unpublished master’s dissertati 

Fifteen different measures were made 
cubes, four elongated columns, and four 
dimensions to form platforms. The centro 
rotation are shown in Table 21 for the ma 
between tests. The three factors indicated 
parameters of x, y, 


on twelve boxes: four 
boxes extended in two 
id factor matrix and its 
trix of intercorrelations 


here, associated with the 
and z, are based on measures of length, width, 
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and breadth respectively. These results are identical with Thur- 
stone’s in identifying factors which are characteristic of the test 
variation; they fail, however, to indicate anything regarding the 
preimposed similarities within the sub-clusters of cubes, columns, 


and platforms. 


Table 22. Centroid Solution Based on Intercorrelations Between Twelve 


Boxes* 

BOX 1 " h? GROUP 
1 86 —.47 .9605 
2 89 —.36 9217 ab 
3 72 —.21 5482 am 
4 92 —.08 .8528 
5 —.21 9 9657 
6 —.35 77 7154 
7 15 an 18506 Column 
8 «44 79 8177 
9 —.63 —.36 5265 

10 —.89 —.19 .8282 

n —90 —.24 18676 | Platform 

12 —.81 —.32 7545 | 


Differentiation of Group Patterns by Transposed Factor Analysis. 


*Reproducod B. M. Chung, 
apraduced from Tho University of Chicago, 1952 


Unpublished master’s dissertation, 


When the matrix of intercorrelations between boxes, rather than 
tests, is subjected to a similar centroid solution another factor pat- 
tern emerges which has no relationship to the preceding analysis. 
As is shown in Table 22, two factors appear of which one is bi- 
polar. Together these account for ninety-three per cent of the esti- 
mated communality. The bi-polar factor accounts for the four 
cubes on the positive axis, the four platforms on the negative axis; 
the second factor represents the four columns. When the boxes are 


plotted in a two-dimensional space determined by factors I and IJ, 


three poles emerge at which the cubes, columns and platforms 


cluster respectively. 
Despite the artificiality of these data, the results are in complete 
actorial composition appears to de- 


accord with our expectations. I 
and differential 


pend on characteristics of both tests and groups, 

information will be yielded by the intertest analysis and the trans- 

posed intergroup analysis in circumstances analogous to those in- 
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corporated in the box problem. The two analyses are possibly 
similar only in the case of a homogeneous population. When per- 
sons belonging to the same criterion group can be assigned to points 
along a linearly determined reference vector, both procedures may 
be expected to yield the same conclusions with respect to factor 
composition. When the group is discontinuously oriented, how- 
ever, a line arranged so as to minimize the distance from any point 
to the center of the various clusters can be expected under certain 
circumstances to be inadequate and unpredictive for any indi- 
vidual case, with a corresponding distortion of factor patterns. 

It also follows, then, that predictability from factorial composi- 
tion should be considerably enhanced once the independent sub- 
groups confounded within the criterion sample have been iso- 
lated. A second investigation was undertaken for this purpose, 
involving a modified transposed analysis of data obtained by Counts 
(15) from a group of students enrolled in a college mathematics 
course who had been administered elev 
Primary Mental Abilities (PMA). The 
efficient between the eleven PMA score: 
mathematics achiev 


en tests of Thurstone’s 
multiple correlation co- 
s and achievement on a 
ement test was +-.44 for the entire group of stu- 
dents. Nine sub-groups of students, identified by means of a trans- 
posed analysis, showed a marked shift in the values of the multiple 
correlation between PMA and achievement when this was recom- 
puted separately for each of the nine sub- 
nine the prediction of mathematics score 
+.59, +.63, +-63, +.65, and +.73 respe 
+.41, and the other three drop to zero. 

The independence of these sub-groups is indicated in two ways. 
The intercorrelations between profiles range from —.46 to +.61 
(10 per cent level of significance is +.60), with a median absolute 
correlation of +.19. Furthermore, the multiple r for the nine 
groups recombined, eliminating members of the three unpredic- 
tive profiles, is only +.59, despite the higher correlations obtaining 
for the individual component groups. There are apparently a num- 
ber of different ways in which the skills represented by the PMA 


groups. For five of the 
from the PMA rises to 
ctively. One remains at 
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can be combined to yield the same level of achievement in mathe- 
matics, as well as a few ways which are quite irrelevant to mathe- 
matics performance (although nevertheless characteristic of some 
sub-groups within the sample of students studied). 

Independent confirmation of the usefulness of this procedure 
has been provided more recently in a study by Dempsey (17). In 
this case correlations between a variety of objective measures and 
criterion ratings were computed for a total sample of eighty stu- 
dents, as well as for separate sub-groups as determined by trans- 
posed analysis. The multiple correlations between measures and 
criterion increased from +.55 for the total sample to an average of 


+.74 for the sub-groups. 


THE MULTIPLE DISCRIMINANT FUNCTION 


Although transposed analysis appears to offer considerable prom- 
ise for assessment research, both in improving predictability from 
test factors and in the identification of typological configurations, it 
is still beset with a number of technical difficulties. The logical 
and mathematical limitations of the technique are largely attribut- 
able to its dependency upon correlational procedures. Stephenson 
himself, an early proponent and innovator of transposed analytic 
procedures, has already begun to stress the advantages of balanced 
factorial designs which preserve the general logic of transposed 
analysis, but recast it in the general context of the Fisherian analy- 
sis of variance (61). Cronbach (16) has recently discussed some of 
these problems, and there is no need to reproduce these considera- 
tions here. 

An alternative approach which would appear to avoid many of 
the difficulties inherent in the correlational procedures associated 
with transposed analysis, has recently been made available through 
Bryan’s (6) generalization of Fisher’s two-group discriminant func- 
tion. Multiple discriminant analysis makes it possible to determine 
whether several empirically differentiated groups in fact occupy 
different regions of a k-dimensional space, whether the distinctions 
between them may be described in a space of fewer dimensions 


239 


Methods in Personality Assessment 
than that originally employed, and finally, permits an exact prob- 
ability statement to be made regarding the degree of correspond- 
ence between any new candidate and each of the several groups for 
which discriminant scores have been obtained. A symposium on the 
multiple discriminant function has been published (74), and ex- 
amples of its application may be found in Tiedeman, Bryan and 
Rulon (73), and in Tiedeman and Sternberg (75) 

It is important to note that transposed analysis and the multiple 
discriminant function are not equivalent procedures. Although 
the discriminant analysis permits an exact statement of similarity 
between the candidate and a given criterion group, 
that the criterion groups be defined on an a priori b 
dertaking the analysis. It will not te 
in the population under iny 
reject) our subjective decisi 


ously specified groups. Tra 
indicate which pe 


it is necessary 
asis before un- 
ll us which groups are present 
estigation, but can only confirm (or 
ons regarding the existence of previ- 
nsposed analysis, on the other hand, will 
rsons cluster together to form groups. From this 
point on the investigator must develop his own ideas regarding the 
meaning and significance of the particular patterns which have 
been so isolated. And the decision as to which group a new candi- 
date should be assigned is almost 
sis as it is precise in the case of tł 
whole, it would seem as if the m 
more to offer at the moment, al 


as uncertain in transposed analy- 
ie discriminant function. On the 
ultiple discriminant function has 
though there is something to be 


which would involve transposed 
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of maximizing 
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who belong to all of the groups which may be studied. This poses 
something of a problem at present, since we have a wide variety of 
cognitive, perceptual, and kinaesthetic tests which require re-in- 
vestigation in the light of the considerations regarding sub-group 
specificity raised here, and a paucity of measures of personality 
which are amenable to mathematical treatment. In this connec- 
tion, attention should be called to the Activities Index referred to 
previously, which provides a series of numerical scores based on 
each of the elements of the personality framework which has been 
employed in the assessment projects described in this volume. The 
current form of the Activities Index has already been found to 
yield discriminable patterns of needs among students enrolled in 
various professional programs. As these data accumulate it will be- 
come possible to submit them to the more rigorous analysis af- 
forded by the mathematical techniques described here, permitting 
the derivation of formulae discriminating between such groups in 
terms of characterological psychodiagnostic constructs. 
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Summary and Conclusions 


THE PURPOSE OF THIS BOOK HAS BEEN TO DESCRIBE 
four types of assessment methodology—analytical, empirical, syn- 
thetic and configurational—and to illustrate them with specific re- 
search projects much like those with which any assessment program 
may typically be confronted. Although these developments were 
provoked by an interest in improving predictions from test data, 
the immediate stimulus for this book came from unresolved prob- 
lems associated with assessment criteria and design. 

The results of the work in the field of tests and measurements 
had indicated that content skills could be predicted with tests 
which contained items related to the skills that would have to be 
utilized in the actual learning situation. With the increased com- 
plexity of the environments for which prediction had to be made, 
it soon became apparent that the measurement of skills alone or 
the concentration on subject matter was insufficient and that the 
assessor, if he were to do an effective job, had to consider person- 
ality and social factors. Based on an organismic or holistic approach 
to the assessment problem, the first large-scale program that had to 
deal with extremely complex environments was the OSS assessment 
program (45). The results of this undertaking were equivocal. One 
of its major stumbling blocks was the criterion problem—a defi- 
ciency which the OSS assessors themselves recognized. The second 
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large-scale assessment program, conducted for the Veterans Ad- 
ministration (32), was also regarded by its directors as unsuccessful. 
Not only was it unable to resolve the criterion problem, but it had 
yielded so few significant findings that one wondered, in the light 
of the expense involved, whether assessment was of any value. 

In our discussion of the criterion problem it was pointed out that 
among other factors which may have plagued assessors (e.g., the 
maintenance of a consistent frame of reference by all assessors) was 
an inadequate distinction between a standard of perform 
a psychological criterion. Thus, a school admini 
to differentiate between “good” and “bad” students, a training 
program director between “good” and “bad” 
trial executive between potentially “good” 
foremen, or sales personnel. In all th 
others (school administrators, 
cate their desires are not settin 
ard of performance w 
achieve. The psycholo. 


ance and 
strator may wish 


trainees, an indus- 
and “bad” executives, 
ese situations the significant 
trainers, and executives) who indi- 
g the criterion, but rather the stand- 
hich they would like their subordinates to 
gist may disagree with the value, significance, 
or relevance of these standards, but this is not part of his problem 
as an assessor, He may prefer to predict against other criteria, per- 
haps in order to demonstrate that people selected according to his 
own standards would do better than those who are already in the 


field, but then he has another type of research problem on his 
hands which goes beyond routine assessment. 
Assessment, as the word has be 


en used in this book, is a threefold 
process involving: 
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proach. During the process of developing the hypothetical model 
the assessor must be very careful to avoid interference from his own 
personal prejudices. He must concentrate on what the significant 
others regard as relevant. Once having obtained the model he can 
rely on his own judgment only in order to determine which are the 
best tests or techniques for obtaining the necessary material from 
the individuals who are to be assessed. 

2. The second aspect of assessment is the study and understand- 
ing of the individual subject. Depending on the specific assessment 
approach selected, the assessor may carry out this study in terms 
of organismic or holistic principles so that a highly organized and 
integrated picture of the individual is obtained, or he may decide 
to study a single variable of a rather complex nature which he 
feels is likely to be related to the criterion. 

3. The third aspect of assessment methodology is to study the 
congruence between the data obtained from an analysis of the in- 
dividual and the characteristics of the hypothetical model, subse- 
quently instituting refinements for purposes of cross-validation. 
The procedures involved here also vary with the specific assessment 
method that is used. In the analytic method the assessors arrive at 
this judgment of congruence through staff conferences. In the 
other methodologies the study of congruence is carried out by sta- 
tistical procedures. 

All four of the methodologies described in this book were based 
on the theoretical proposition that behavior is a function of the 
transactional relationship between the person and his environ- 
ment. We did not examine or evaluate all the elements of this 
proposition, but limited ourselves to a discussion of some of the 
critical factors involved in both the environment and the indi- 
vidual frame of reference since it is the relationship between these 
two which provides the context from which the four methodologies 
are derived. 

Having acquainted himself with the various assessment method- 
ologies, the reader may well have asked himself which of them is 
to be preferred, or what techniques should be included in his own 
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program. In response to the second part of the sii it may Dp 
said that, although each of the authors of this book may have par 
ticular preferences, no one technique is selected for recommenda- 
tion. Thus, some individuals in the future might well desine to 
utilize the Minnesota Multiphasic Personality Inventory, Guilford- 
Zimmerman, Szondi, Mosaic Test, or any other test or technique 
in place of those we have used. To be sure, we would hope that 
some of the techniques that have been described, e.g., the Activities 
Index, and which have not received thorough attention elsewhere, 
might be considered in future work. But our primary aim was not 
to test tests, but to discuss methodologies. The complete answer to 
the first part of the question—which is the most effective method- 
ology—is impossible at the present time, for each methodology was 
not “pitted” against the others. The best that can be done is to dis- 
cuss some of the factors that might be considered bef 
assessment program is embarked upon. 

The analytic assessment method is time 
tests and procedures utilized in the analytic assessment projects de- 
scribed in Chapters 3, 4 and 5, approximately two and a half hours 
were spent on the interview and three and a half hours were spent 


in administering the projective tests for each case. It is difficult to 
estimate the time involved in the an 
the case conference, 


ore a specific 


-consuming. With the 


individuals. To this should be 
added the time requi 
ditional hour and 
With all the time 5 


—- 
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described here, since they were carried out by university personnel 
with research interests. In view of all the time involved in the 
analytic method it is apparent that only a relatively small num- 
ber of subjects can be assessed within a given period. Finally, the 
analytic method requires more time to be spent by the staff than 
any of the other approaches in integrating theories, points of view, 
and assessing congruences between each of the individual subjects 
and the hypothetical model. 

One auxiliary benefit of the analytic method, which is not neces- 
sarily available in the others, is a complete case study of the in- 
dividual subject which may be utilized for counselling purposes, 
whether it be for a change of occupational or professional goals or 
for therapy. In the analytic assessment projects described here, 
complete case studies were not prepared, however, since this would 
have gone beyond the immediate purpose of these studies. 

Since the empirical and configurational assessment methods have 
much in common, they will be considered together. In both these 
methodologies costs depend in large measure on the number of 
techniques that are used initially and the number of subjects who 
are to be assessed. Cost for staff need not necessarily be as high as 
in the analytic assessment method, for it is possible to use tech- 
nicians or clerical personnel to administer and score the tests, 
trained personnel being required only for developing the criterion 
model and in the use of the necessary statistical procedures. It is also 
conceivable that the empirical and configurational methods can be 
carried out by a single competent person. Time, money, and staff 
are also required for the cross-validation study that is necessary in 
both empirical and configurational methods. In these two methods 
the subjects’ time obviously depends on the number of tests used, 
but there is the advantage here that large numbers of subjects can 
be tested in a group testing program. Finally, these two methods 
require very little time from the significant others (faculty, etc.), 


for they need only give the assessor their designation of the criterion 


subjects. 


The synthetic approach is probably the least costly in terms of 
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time and money. In a sense there is no way of estimating the 
amount of time involved in the initial phases here, for the investi- 
gator may come up with his single measure rather quickly or only 
after much thought and deliberation. But once this has been ac- 
complished, time is involved in developing the questionnaire and 
the only cost is that involved in reproducing it, administering it, 
scoring it, and analyzing the results. Subjects’ time depends on the 
length of the questionnaire, but large groups of subjects can be 
tested. No time is taken from the significant others. The one prob- 
lem with this approach is that there is no a priori certainty, other 
than the confidence of the investigator, that representatives of the 
personalities for whom the test has been constructed will be found 
among the candidates who are to be assessed. 


Additional cautions that apply to all assessment programs need 
to be made explicit: 


l. In an assessment program in w 


hich the assessors need to rely 
on the judgments of the sig 


nificant others, the assessors must make 
certain that the people they have selected are really the significant 
others. At times the significant others may be the individuals who 
are in the forefront of the organization—the individuals with power 
and prestige to control the situation—but sometimes they are the 
people behind the scenes who must be ferreted out. 

2. These individuals must have 
basis for differentiating among the candidates to be assessed. 

3. The third major caution to the assessor, and this applies 


to all assessment methods, is to watch rather carefully the time span 
for which he makes his predictions. Too oft 


tion to make long-term predictions w 
environment within which the perso’ 


a reliable and communicable 


en there is the tempta- 
hich go beyond the particular 
n has been assessed. The theo- 


and our later experiences in 


logical school assessment program 
assessing for the successful minister have indicated 


that the char- 
acteristics of students and postgraduates may differ 


respects. Thus, there seem to be significant differe 
those characteristics which make for success in theo 
and those which make for success in the ministry. I 


in significant 
nces between 
logical school 
n emphasizing 
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this caution the theoretical framework of the methodologies re- 
ported here needs to be recalled—when the environment changes 
in critical details a new assessment is necessary. 

The research programs that were conducted to illustrate the 
various methodologies also yielded material of substantive interest. 
ies used in the studies reported here, which are not 


Four techniqu 
hich seem to warrant fur- 


too well-known at the present time but w 
, are: the Activities Index, the Inventory of Be- 
liefs, the Physiognomic Cue and the Drawings. Since the research 
reported here was completed, the Activities Index has undergone 
further revision by Stern as well as by Lane and Bloom. The sub- 
scales have been made equal in length and a method has been de- 
economical hand-scoring. Preliminary studies of the 
etween the Index and various projective tests appear 
to indicate that diagnostic statements made on the basis of the 
borne out by the other instruments. Further work with 
ern involves the investigation of 
differentiating between a variety 


ther investigation 


veloped for 
relationship b 


Index are 
the Index now in progress by St 
characteristic personality patterns 


of occupational and professional groups. 
The Inventory of Beliefs has been utilized in an assessment 


study at a second college providing a successful replication of the 
results reported here, and is the basis for a current series of studies 
by Stern and his associates on behavioral, ideational, and percep- 
tual differences between representatives of the personality syn- 
dromes involved. 

While the Physiognomic Cue test 
entiating our subjects, it has been use 
cess in differentiating between successfu 
in an Army program. Bloom and Lane h 
test in a study of college students, and Stein 
and organic patients with the test. 
olved the drawing of a person 
fic role. It has since 
1), and is cur- 
he mothers of 


was not successful in differ- 
d by Getzells with some suc- 
] and unsuccessful teachers 
ave continued using the 
has begun to study a 


series of paranoid 

The Drawing test reported here inv 
and the drawing of a situation involving a speci 
dgers in a study of salesmen (5 


been utilized by Ro 
Lakin and Stein in a study of t 


rently being used by 
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colicky and non-colicky children, by Cole and Stern in a study of 
chronic aborters, by Stern in a study of school administrators, and 
by Stein et al. ina study of creativity. In general, these studies have 
indicated the importance of a number of differentiating factors, 
including: the sequence in which the 
other persons, and himself; the relative 
in the role drawing, 


subject draws equipment, 
sizes of the various figures 
and in comparison with the single-person draw- 
ings; the manner in which the subject characterizes the role situa- 


tion; etc. 

The second area of substantive findings refers to the content of 
the research projects, or what might typically be referred to as re- 
search results. Although they have been stated in the context of the 
book, several of the more interesting ones will be collated here. 

The study that was conducted to amplify some aspects of the 
analytic assessment method revealed that the assessors were more 
able to differentiate among the personalities of pupils in an ele- 
mentary school than were their teachers. The teachers tended to 
see their pupils as similar to themselves, as well as similar to their 
stereotypes of the ideal pupil. As the assessment staff was provided 
with more information, it tended to develop an increasingly stable 


disrupted. 
he areas of theology, teacher- 
mimunalities and differences 


The teachers and theologians stressed ti 


he importance of friendly 
interpersonal relations to a greater exte 


nt than did the physicists. 
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Yet the two groups (teachers and theologians) achieve their ends in 
different ways—the teachers are more nurturant and the theologians 
more succorant or dependent. Physicists place greater emphasis on 
independence and self-sufficiency. 

In the area of impulse acceptance and impulse control it was 
found that teachers and theologians indicate erotic interest and 
value amusement and entertainment—the teachers give more evi- 
dence for this than do the theologians. The physicists, on the other 
hand, tend to be capable of delaying immediate gratification of 
their impulses. They permit their erotic needs to build up and then 
discharge them in a brief period. After they satisfy their erotic in- 
terests the physicists tend to dissociate themselves from their ex- 
periences and return to work, in contrast to the teachers and theo- 
ve more evidence of guilt or anxiety over the possible 
der these circumstances. 
refer unroutinized, labile, novel and variable 
mewhat less intent in 


logians who gi 
reaction of others un 


While the teachers p 
behavior and while the theologians are sor 
their interests in these areas, both groups differ from the physicists 


who tend to be hesitant, cautious, deliberative, and lacking in 


spontaneity. 


The physicists show some ambivalence about their achievement 


drives and differ from the other groups in their interest in physical 
phenomena and in intellectualization as an end in itself. The physi- 
cists also stress the importance of restriving to overcome experi- 
enced frustration, failure or humiliation. 


Aside from the concrete results presented 
dicate the directive nature of personal 
) their various professions. Future Te- 
tional significant relationships 


above, the studies we 


have carried out ini needs 


in channeling individuals t 
search will no doubt indicate addi 


ersonality factors and occupation: 
ndex also revealed data relating to high and low 
program. High achievers were characterized 
sness and maturity than one might regard 
than did the low achievers. The high 
rest in intellectual activities than do 
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the low achievers, whereas the latter are more interested in play 
and social activities. An interesting problem for future research 
would be to determine whether the low achievers become inter- 
ested in play and social activities because of their relative lack of 
academic success or because these interests make it difficult for 
them to concentrate on their work. 

The data from the Inventory of Beliefs used in 
assessment study revealed that 
Stereopaths than Non-Stereo 
ied. Stereopaths preferred o 
cine and law, involving 


the synthetic 
a significantly higher number of 
paths withdrew from the college stud- 
ccupations such as engineering, medi- 


Prestigious activities of an impersonal or 
concrete nature. The Non-Stereopaths pre 


volving interpersonal, expressive or abstrac 
chology, music or theoretical physics, 
higher scores on the computational 
Preference Record, but the N 
in the areas of art, music, and 


ferred occupations in- 
t activities such as psy- 
The Stereopaths received 
and clerical parts of the Kuder 
on-Stereopaths received higher scores 
social service. The Stereopaths were 
ial status and security. They might 
issive or dependent, and as cathecting 
ery strongly. The Non-Stereopath, on the other 
interest in activities that allowed for autonomy 


and for the Satisfaction of their interests in ab- 
desthetic experiences, 


sment method—configu rational assessment—sug- 


hand, indicated an 
and independence, 
stract, analytical an 


of the techniques that 
of the results of the re- 
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search studies. But, as in other areas, there are auxiliary values to 
be gained from assessment which are not directly related to the 
purposes of assessment. 

All of our assessment projects were conducted in educational 
institutions. In each of these we were impressed with the height- 
ened faculty interest in the students to which these projects ap- 
peared to contribute. The different faculties gained satisfaction 
from having obtained greater knowledge of their students and 
from understanding certain facets of their students’ personalities 
which were previously obscure to them. To be sure, the extent of 
such satisfaction was greater in those assessment studies where the 
faculty had frequent contact with the assessment staff than was true 
in the non-analytic alternatives. 

For the assessment staff the various experiences revealed some 
of the difficulties that might arise in communicating psychological 
data to non-psychologists and the ensuing satisfaction when these 
difficulties were resolved. In addition, these studies demonstrated 
their usefulness as training programs for the graduate students in 
psychology. The students participating in these projects saw rather 
clearly what was meant by “an integrated picture of the individual” 
and learned not only how to arrive at this, but also how to com- 
municate effectively with their own professional colleagues and 
others. 

In this book we have focussed upon assessment methodology and 
indicated how assessment can be made more effective if both the 
individual and the environment are considered. In a sense, there- 
fore, the emphasis was on prediction. But assessment may also have 
a feedback function. Thus, when the criterion model has been de- 
veloped and established by cross-validation procedures, it is of po- 
tentially great value to the administrator, director, or executive 
who sponsors the assessment work in that it describes for him the 
types of individuals who may or who may not be able to function 
effectively in their specific environments. In certain instances this 
may not be new information, but in our experiences we have also 
found sponsors who are surprised at some if not all of these details. 
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Such information, if it is accepted, may then be utilized not only 
for the more careful selection of students and personnel, but may 
also be used in the re-evaluation of the standards that have been 
utilized heretofore, and in the development of teaching and train- 
ing procedures that may be applied to the existing personnel with 
increased effectiveness. Assessment methodology, therefore, has 
significant implications for psychodiagnosis, prediction, recruit- 
ment, selection, training, and institutional evaluation. 
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Activities Index, 150-151, 216-218 
analytical approach, 80-81, 88, 92- 
96, 99, 102-104, 250-251 
configurational approach, 235-236, 
252 
drawing, 142 
emotional stability, 84-85 
empirical approach, 140-144, 151- 
153, 158-159, 162-170, 180-183, 
250-251 
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instructor ratings, 168-170 
intelligence tests, 34, 141, 163, 203- 
204 
Inventory of Beliefs, 132, 199-200 
Perceptual-Cognitive tests, 164-167 
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projective data, 141-142, 149, 221- 
226 
statistical models, 252-236 
stereotypy type, 166-167 
student records, 206-208 
synthetic approach, 201-202, 215- 
218, 252 
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judgments, 86-87, 88, 96-99, 152 
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N,R\S,-syndromes, 190-193, 197-198, 
216-218, 221-226 
press limits, 17-18, 3 
58-60, 80, 92, 14? 
176 
time factors, 39, 248 
Predispositions, congenital, 46 
Press, 
alpha, 36-37, 40, 46 
assessment concept, 38-39 
beta, 40, 61-67 


2-33, 36-45, 54, 
, 162-163 


beta, common, (see Common beta 
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College, 162-163, 173-176, 191-192, 


197, 204, 206, 208, 210, 213-214 
definition, 36, 53 
educational, (see Institutional press) 
explicit and implicit, 55, 73 
institutional, (see Institutional press) 
learning, 42-45, 58 
previous situational influence, 46 
private beta, (see Private beta press) 
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situational, 75, 127-128, 248-249 
seminary press, 78-80 
Primary Mental Abilities Test, 238 
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definition, 38 
properties of, 38 
Relationship of assessor, 38 
Problem solving, by child, 49 
Professional role, perception 
Profile, unidimensional, 231 
Programs, assessment, (see Assessment 
programs) 
Progressive Education Association, 128 
Projective tests, (see also Psychodiag- 
nostic tests), 26, 29 
comparison with Activities Index, 14l- 
144, 148-151 
description, 65-67 
drawings, 128, 140, 148, 150, 249-250 
essays, 140-141 
evaluation of projective data, 94-96, 
118, 141-148, 148-150, 218-226 
figure drawings, 103, 113, 128 
perception of professional role, 128 
Rorschach, 11, 65-67, 81, 94, 103, 113, 
123, 133, 141-142, 148, 150, 158, 194 
protocol content in synthetic study, 
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267 


Q-sort (cont.) 
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Rejection need, definition, 70 

Relevant Thinking Test, 167-168, 171- 
172, 207 

Reliability coefficients, Inventory of Be- 
liefs Form T, 200 

Research competence, 32-34 
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non-stcreopathic characteristics, 197, 
225 
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Projective data Protocol, 224-296 
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Sameness need, definition, 73 
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167 
Stereotypy study, (see also Inventory of 
Beliefs; N,R,S.-syndromes; Syn- 
thetic approach) 
Activities Index descriptions of stu- 
dents, 217-218 
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criterion, 78-81, 88 
emotional stability, 84-85 
faculty ideal, 78-80 
hypothetical model, 80-81 
intelligence quotient (1.Q.), 84 
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